2021-02-13T16:57:20.973 INFO:root:teuthology version: 1.1.0-87d40f79 2021-02-13T16:57:20.974 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877897 --name yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba --description rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} --verbose --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877897/orig.config.yaml 2021-02-13T16:57:21.017 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-02-13T16:57:21.074 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877897 branch: wip-yuri3-testing-2021-02-12-0757-nautilus description: rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} email: ceph-qa@ceph.io first_in_suite: false job_id: '5877897' kernel: kdb: true sha1: distro last_in_suite: false machine_type: gibba name: yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba nuke-on-error: true os_type: ubuntu overrides: admin_socket: branch: wip-yuri3-testing-2021-02-12-0757-nautilus ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= rgw curl low speed time: 300 rgw data log num shards: 4 rgw md log max shards: 4 rgw sync log trim interval: 0 rgw sync obj etag verify: true global: osd heartbeat grace: 40 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 osd fast shutdown: false osd.0: osd_max_omap_entries_per_request: 10 osd.1: osd_max_omap_entries_per_request: 1000 osd.2: osd_max_omap_entries_per_request: 10000 log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 7194982cc16a1fd51df59ee58e1c54797c4465d1 wait-for-scrub: false ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 7194982cc16a1fd51df59ee58e1c54797c4465d1 rgw: compression type: random frontend: beast rgw-multisite: realm: is default: true name: test-realm zonegroups: - endpoints: - c1.client.0 is_default: true is_master: true name: test-zonegroup zones: - endpoints: - c1.client.0 is_default: true is_master: true name: test-zone1 - endpoints: - c2.client.0 is_default: true name: test-zone2 - endpoints: - c1.client.1 name: test-zone3 - endpoints: - c2.client.1 is_pubsub: true name: test-zone4 workunit: branch: wip-yuri3-testing-2021-02-12-0757-nautilus sha1: 7194982cc16a1fd51df59ee58e1c54797c4465d1 owner: scheduled_yuriw@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - c1.mon.a - c1.mgr.x - c1.osd.0 - c1.osd.1 - c1.osd.2 - c1.client.0 - c1.client.1 - - c2.mon.a - c2.mgr.x - c2.osd.0 - c2.osd.1 - c2.osd.2 - c2.client.0 - c2.client.1 sha1: 7194982cc16a1fd51df59ee58e1c54797c4465d1 sleep_before_teardown: 0 suite: rgw suite_branch: wip-yuri3-testing-2021-02-12-0757-nautilus suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 7194982cc16a1fd51df59ee58e1c54797c4465d1 targets: gibba037.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzABDCsGE9yRhAkC6g75qKS7gUEu8hpPCM5R4uj5uToKOrjI8K+TxzOqQwnmxD84g3IltOBDEnv8a06qFbeI0GYvItL3MELTesE9s8aVAgkhmzSn7wYdnRH8EY+sIRY2RHWDzrK8OxKN0d1XR1fjPsoh2fbZ2saFRLt12+//zy6AsVghxQxC1d0CAeCqUQvHgKwMQaR+3fTuszGC6SUqbgwUvtB2tz8c4o5B+GbBd8FIS/IbEGIdYd4GhPRVrNLz8fAGO5ghtdgP41/RFxNxRsLqojliWWAu+tVbS12Ba+/wUPjdo0iRk+l87KEhFgP8+MMX0zcc4S5pwrzy1iaplL gibba038.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDD7VwUSrYdHXOl4pmIZcvEij6kXTpMa6hWNCa/64cQ49FwHErn3O5fxtxDVgAv9Bj+bFPArBTvEu/YPwrNeMK+siR3jG85n4JW0Xi5loAw1FgI8jV246kTf6qjxIfd3kRbVfSzMm6EY2LZAJlwe66czjKkYWoVVKUSS5S3IUPlxWCzZDP9hNpbVN9IgI6NQ/E/C8EHVp69+e+k+TYC5Wh64OutsMswwGml3X8tFu+M8NIJYePKC7k5OTix4+GQWiiY89ckU7mjpLVLC3kwPciVPf5wDck04ZJwwmpZwi+Mqp4d81o8RhbVjbVFpmGDdIZHOLa2fRQfm3hSSjgFJrVh tasks: - install: null - ceph: cluster: c1 - ceph: cluster: c2 - rgw: c1.client.0: port: 8000 c1.client.1: port: 8001 c2.client.0: port: 8000 c2.client.1: port: 8001 - rgw-multisite: null - rgw-multisite-tests: config: reconfigure_delay: 60 teuthology_branch: master teuthology_sha1: 87d40f79d7da6caf6da06c190938773bf745140c timestamp: 2021-02-12_17:45:41 tube: gibba user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.gibba.29737 2021-02-13T16:57:21.075 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa; will attempt to use it 2021-02-13T16:57:21.075 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks 2021-02-13T16:57:21.075 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-02-13T16:57:21.077 INFO:teuthology.task.internal:Checking packages... 2021-02-13T16:57:21.100 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash '7194982cc16a1fd51df59ee58e1c54797c4465d1' 2021-02-13T16:57:21.100 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-02-13T16:57:21.101 INFO:teuthology.packaging:ref: None 2021-02-13T16:57:21.101 INFO:teuthology.packaging:tag: None 2021-02-13T16:57:21.101 INFO:teuthology.packaging:branch: wip-yuri3-testing-2021-02-12-0757-nautilus 2021-02-13T16:57:21.101 INFO:teuthology.packaging:sha1: 7194982cc16a1fd51df59ee58e1c54797c4465d1 2021-02-13T16:57:21.101 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=wip-yuri3-testing-2021-02-12-0757-nautilus 2021-02-13T16:57:21.272 INFO:teuthology.task.internal:Found packages for ceph version 14.2.16-285-g7194982c-1bionic 2021-02-13T16:57:21.272 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-02-13T16:57:21.294 INFO:teuthology.task.internal:no buildpackages task found 2021-02-13T16:57:21.294 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-02-13T16:57:21.375 INFO:teuthology.task.internal:Saving configuration 2021-02-13T16:57:21.389 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-02-13T16:57:21.400 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-13T16:57:21.419 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-02-13 16:52:04.283145', 'description': '/home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877897', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILJPEE119a4NSz87RmfH/HoLnKB64bXFucby94HlGtH+', 'os_version': '18.04', 'machine_type': 'gibba', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'gibba037.front.sepia.ceph.com'} 2021-02-13T16:57:21.436 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-02-13 16:52:04.283164', 'description': '/home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877897', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGTt66gf2ixAZlTKN6138sfJi81xkgv2OOKrlPY/ONDC', 'os_version': '18.04', 'machine_type': 'gibba', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'gibba038.front.sepia.ceph.com'} 2021-02-13T16:57:21.436 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-02-13T16:57:21.446 INFO:teuthology.task.internal:roles: ubuntu@gibba037.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'] 2021-02-13T16:57:21.446 INFO:teuthology.task.internal:roles: ubuntu@gibba038.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2021-02-13T16:57:21.446 INFO:teuthology.run_tasks:Running task console_log... 2021-02-13T16:57:21.522 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f88d92420d0>, signals=[15]) 2021-02-13T16:57:21.522 INFO:teuthology.run_tasks:Running task internal.connect... 2021-02-13T16:57:21.533 INFO:teuthology.task.internal:Opening connections... 2021-02-13T16:57:21.533 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba037.front.sepia.ceph.com 2021-02-13T16:57:21.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T16:57:21.638 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba038.front.sepia.ceph.com 2021-02-13T16:57:21.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T16:57:21.712 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-02-13T16:57:21.723 DEBUG:teuthology.orchestra.run.gibba037:> uname -m 2021-02-13T16:57:21.726 INFO:teuthology.orchestra.run.gibba037.stdout:x86_64 2021-02-13T16:57:21.726 DEBUG:teuthology.orchestra.run.gibba037:> cat /etc/os-release 2021-02-13T16:57:21.770 INFO:teuthology.orchestra.run.gibba037.stdout:NAME="Ubuntu" 2021-02-13T16:57:21.771 INFO:teuthology.orchestra.run.gibba037.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-02-13T16:57:21.771 INFO:teuthology.orchestra.run.gibba037.stdout:ID=ubuntu 2021-02-13T16:57:21.771 INFO:teuthology.orchestra.run.gibba037.stdout:ID_LIKE=debian 2021-02-13T16:57:21.771 INFO:teuthology.orchestra.run.gibba037.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-02-13T16:57:21.771 INFO:teuthology.orchestra.run.gibba037.stdout:VERSION_ID="18.04" 2021-02-13T16:57:21.771 INFO:teuthology.orchestra.run.gibba037.stdout:HOME_URL="https://www.ubuntu.com/" 2021-02-13T16:57:21.771 INFO:teuthology.orchestra.run.gibba037.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-02-13T16:57:21.771 INFO:teuthology.orchestra.run.gibba037.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-02-13T16:57:21.771 INFO:teuthology.orchestra.run.gibba037.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-02-13T16:57:21.771 INFO:teuthology.orchestra.run.gibba037.stdout:VERSION_CODENAME=bionic 2021-02-13T16:57:21.771 INFO:teuthology.orchestra.run.gibba037.stdout:UBUNTU_CODENAME=bionic 2021-02-13T16:57:21.772 INFO:teuthology.lock.ops:Updating gibba037.front.sepia.ceph.com on lock server 2021-02-13T16:57:21.788 DEBUG:teuthology.orchestra.run.gibba038:> uname -m 2021-02-13T16:57:21.807 INFO:teuthology.orchestra.run.gibba038.stdout:x86_64 2021-02-13T16:57:21.807 DEBUG:teuthology.orchestra.run.gibba038:> cat /etc/os-release 2021-02-13T16:57:21.850 INFO:teuthology.orchestra.run.gibba038.stdout:NAME="Ubuntu" 2021-02-13T16:57:21.850 INFO:teuthology.orchestra.run.gibba038.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-02-13T16:57:21.850 INFO:teuthology.orchestra.run.gibba038.stdout:ID=ubuntu 2021-02-13T16:57:21.850 INFO:teuthology.orchestra.run.gibba038.stdout:ID_LIKE=debian 2021-02-13T16:57:21.850 INFO:teuthology.orchestra.run.gibba038.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-02-13T16:57:21.850 INFO:teuthology.orchestra.run.gibba038.stdout:VERSION_ID="18.04" 2021-02-13T16:57:21.850 INFO:teuthology.orchestra.run.gibba038.stdout:HOME_URL="https://www.ubuntu.com/" 2021-02-13T16:57:21.850 INFO:teuthology.orchestra.run.gibba038.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-02-13T16:57:21.850 INFO:teuthology.orchestra.run.gibba038.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-02-13T16:57:21.850 INFO:teuthology.orchestra.run.gibba038.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-02-13T16:57:21.850 INFO:teuthology.orchestra.run.gibba038.stdout:VERSION_CODENAME=bionic 2021-02-13T16:57:21.851 INFO:teuthology.orchestra.run.gibba038.stdout:UBUNTU_CODENAME=bionic 2021-02-13T16:57:21.851 INFO:teuthology.lock.ops:Updating gibba038.front.sepia.ceph.com on lock server 2021-02-13T16:57:21.864 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-02-13T16:57:21.883 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-02-13T16:57:21.902 INFO:teuthology.task.internal:Checking for old test directory... 2021-02-13T16:57:21.902 DEBUG:teuthology.orchestra.run.gibba037:> test '!' -e /home/ubuntu/cephtest 2021-02-13T16:57:21.904 DEBUG:teuthology.orchestra.run.gibba038:> test '!' -e /home/ubuntu/cephtest 2021-02-13T16:57:21.906 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-02-13T16:57:21.941 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-02-13T16:57:21.941 DEBUG:teuthology.orchestra.run.gibba037:> test -z $(ls -A /var/lib/ceph) 2021-02-13T16:57:21.949 DEBUG:teuthology.orchestra.run.gibba038:> test -z $(ls -A /var/lib/ceph) 2021-02-13T16:57:21.958 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-02-13T16:57:22.003 INFO:teuthology.run_tasks:Running task kernel... 2021-02-13T16:57:22.038 DEBUG:teuthology.task.kernel:normalized config {'c1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c1.mgr.x': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.0': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.1': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.2': {'kdb': True, 'sha1': 'distro'}, 'c1.client.0': {'kdb': True, 'sha1': 'distro'}, 'c1.client.1': {'kdb': True, 'sha1': 'distro'}, 'c2.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c2.mgr.x': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.0': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.1': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.2': {'kdb': True, 'sha1': 'distro'}, 'c2.client.0': {'kdb': True, 'sha1': 'distro'}, 'c2.client.1': {'kdb': True, 'sha1': 'distro'}} 2021-02-13T16:57:22.038 INFO:teuthology.task.kernel:config {'c1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c2.mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-02-13T16:57:22.038 DEBUG:teuthology.orchestra.run.gibba037:> uname -r 2021-02-13T16:57:22.041 INFO:teuthology.orchestra.run.gibba037.stdout:4.15.0-122-generic 2021-02-13T16:57:22.041 INFO:teuthology.task.kernel:Running kernel on gibba037: 4.15.0-122-generic 2021-02-13T16:57:22.041 DEBUG:teuthology.orchestra.run.gibba037:> sudo apt-get clean 2021-02-13T16:57:22.113 DEBUG:teuthology.orchestra.run.gibba037:> sudo apt-get update 2021-02-13T16:57:22.238 INFO:teuthology.orchestra.run.gibba037.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-02-13T16:57:22.355 INFO:teuthology.orchestra.run.gibba037.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-13T16:57:22.397 INFO:teuthology.orchestra.run.gibba037.stdout:Get:3 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [916 kB] 2021-02-13T16:57:22.435 INFO:teuthology.orchestra.run.gibba037.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-02-13T16:57:22.506 INFO:teuthology.orchestra.run.gibba037.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,544 kB] 2021-02-13T16:57:22.534 INFO:teuthology.orchestra.run.gibba037.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [298 kB] 2021-02-13T16:57:22.539 INFO:teuthology.orchestra.run.gibba037.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/restricted i386 Packages [13.5 kB] 2021-02-13T16:57:22.539 INFO:teuthology.orchestra.run.gibba037.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [226 kB] 2021-02-13T16:57:22.542 INFO:teuthology.orchestra.run.gibba037.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [29.9 kB] 2021-02-13T16:57:22.542 INFO:teuthology.orchestra.run.gibba037.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,109 kB] 2021-02-13T16:57:22.557 INFO:teuthology.orchestra.run.gibba037.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [975 kB] 2021-02-13T16:57:22.568 INFO:teuthology.orchestra.run.gibba037.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [248 kB] 2021-02-13T16:57:22.570 INFO:teuthology.orchestra.run.gibba037.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [9,208 B] 2021-02-13T16:57:22.570 INFO:teuthology.orchestra.run.gibba037.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [26.0 kB] 2021-02-13T16:57:22.571 INFO:teuthology.orchestra.run.gibba037.stdout:Get:15 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [5,272 B] 2021-02-13T16:57:22.696 INFO:teuthology.orchestra.run.gibba037.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-02-13T16:57:22.778 INFO:teuthology.orchestra.run.gibba037.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,884 kB] 2021-02-13T16:57:23.099 INFO:teuthology.orchestra.run.gibba037.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,220 kB] 2021-02-13T16:57:23.150 INFO:teuthology.orchestra.run.gibba037.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [390 kB] 2021-02-13T16:57:23.166 INFO:teuthology.orchestra.run.gibba037.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [20.2 kB] 2021-02-13T16:57:23.166 INFO:teuthology.orchestra.run.gibba037.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [247 kB] 2021-02-13T16:57:23.177 INFO:teuthology.orchestra.run.gibba037.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [33.4 kB] 2021-02-13T16:57:23.177 INFO:teuthology.orchestra.run.gibba037.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,560 kB] 2021-02-13T16:57:23.213 INFO:teuthology.orchestra.run.gibba037.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,718 kB] 2021-02-13T16:57:23.262 INFO:teuthology.orchestra.run.gibba037.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [363 kB] 2021-02-13T16:57:23.277 INFO:teuthology.orchestra.run.gibba037.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [14.3 kB] 2021-02-13T16:57:23.278 INFO:teuthology.orchestra.run.gibba037.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [31.8 kB] 2021-02-13T16:57:23.278 INFO:teuthology.orchestra.run.gibba037.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [7,300 B] 2021-02-13T16:57:23.974 INFO:teuthology.orchestra.run.gibba037.stdout:Fetched 13.1 MB in 2s (7,918 kB/s) 2021-02-13T16:57:25.032 INFO:teuthology.orchestra.run.gibba037.stdout:Reading package lists... 2021-02-13T16:57:25.066 DEBUG:teuthology.orchestra.run.gibba037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-02-13T16:57:25.116 INFO:teuthology.orchestra.run.gibba037.stdout:Reading package lists... 2021-02-13T16:57:25.313 INFO:teuthology.orchestra.run.gibba037.stdout:Building dependency tree... 2021-02-13T16:57:25.313 INFO:teuthology.orchestra.run.gibba037.stdout:Reading state information... 2021-02-13T16:57:25.366 INFO:teuthology.orchestra.run.gibba037.stderr:E: Unable to locate package linux-image-current-generic 2021-02-13T16:57:25.366 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-02-13T16:57:25.367 DEBUG:teuthology.orchestra.run.gibba037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-02-13T16:57:25.454 INFO:teuthology.orchestra.run.gibba037.stdout:Reading package lists... 2021-02-13T16:57:25.618 INFO:teuthology.orchestra.run.gibba037.stdout:Building dependency tree... 2021-02-13T16:57:25.619 INFO:teuthology.orchestra.run.gibba037.stdout:Reading state information... 2021-02-13T16:57:25.720 INFO:teuthology.orchestra.run.gibba037.stdout:The following additional packages will be installed: 2021-02-13T16:57:25.720 INFO:teuthology.orchestra.run.gibba037.stdout: linux-generic linux-headers-4.15.0-135 linux-headers-4.15.0-135-generic 2021-02-13T16:57:25.720 INFO:teuthology.orchestra.run.gibba037.stdout: linux-headers-generic linux-image-4.15.0-135-generic 2021-02-13T16:57:25.720 INFO:teuthology.orchestra.run.gibba037.stdout: linux-modules-4.15.0-135-generic linux-modules-extra-4.15.0-135-generic 2021-02-13T16:57:25.720 INFO:teuthology.orchestra.run.gibba037.stdout:Suggested packages: 2021-02-13T16:57:25.721 INFO:teuthology.orchestra.run.gibba037.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2021-02-13T16:57:25.721 INFO:teuthology.orchestra.run.gibba037.stdout:Recommended packages: 2021-02-13T16:57:25.721 INFO:teuthology.orchestra.run.gibba037.stdout: thermald 2021-02-13T16:57:25.735 INFO:teuthology.orchestra.run.gibba037.stdout:The following NEW packages will be installed: 2021-02-13T16:57:25.736 INFO:teuthology.orchestra.run.gibba037.stdout: linux-headers-4.15.0-135 linux-headers-4.15.0-135-generic 2021-02-13T16:57:25.736 INFO:teuthology.orchestra.run.gibba037.stdout: linux-image-4.15.0-135-generic linux-modules-4.15.0-135-generic 2021-02-13T16:57:25.736 INFO:teuthology.orchestra.run.gibba037.stdout: linux-modules-extra-4.15.0-135-generic 2021-02-13T16:57:25.736 INFO:teuthology.orchestra.run.gibba037.stdout:The following packages will be upgraded: 2021-02-13T16:57:25.736 INFO:teuthology.orchestra.run.gibba037.stdout: linux-generic linux-headers-generic linux-image-generic 2021-02-13T16:57:25.903 INFO:teuthology.orchestra.run.gibba037.stdout:3 upgraded, 5 newly installed, 0 to remove and 88 not upgraded. 2021-02-13T16:57:25.903 INFO:teuthology.orchestra.run.gibba037.stdout:Need to get 66.0 MB of archives. 2021-02-13T16:57:25.903 INFO:teuthology.orchestra.run.gibba037.stdout:After this operation, 334 MB of additional disk space will be used. 2021-02-13T16:57:25.903 INFO:teuthology.orchestra.run.gibba037.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-135-generic amd64 4.15.0-135.139 [13.1 MB] 2021-02-13T16:57:26.899 INFO:teuthology.orchestra.run.gibba037.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-135-generic amd64 4.15.0-135.139 [8,019 kB] 2021-02-13T16:57:27.128 INFO:teuthology.orchestra.run.gibba037.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-135-generic amd64 4.15.0-135.139 [32.8 MB] 2021-02-13T16:57:28.022 INFO:teuthology.orchestra.run.gibba037.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.135.122 [1,868 B] 2021-02-13T16:57:28.022 INFO:teuthology.orchestra.run.gibba037.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.135.122 [2,592 B] 2021-02-13T16:57:28.023 INFO:teuthology.orchestra.run.gibba037.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-135 all 4.15.0-135.139 [10.9 MB] 2021-02-13T16:57:28.317 INFO:teuthology.orchestra.run.gibba037.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-135-generic amd64 4.15.0-135.139 [1,097 kB] 2021-02-13T16:57:28.342 INFO:teuthology.orchestra.run.gibba037.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.135.122 [2,488 B] 2021-02-13T16:57:28.642 INFO:teuthology.orchestra.run.gibba037.stdout:Fetched 66.0 MB in 3s (25.4 MB/s) 2021-02-13T16:57:28.774 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package linux-modules-4.15.0-135-generic. 2021-02-13T16:57:28.790 INFO:teuthology.orchestra.run.gibba037.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102071 files and directories currently installed.) 2021-02-13T16:57:28.791 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../0-linux-modules-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-13T16:57:28.830 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking linux-modules-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T16:57:30.096 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package linux-image-4.15.0-135-generic. 2021-02-13T16:57:30.099 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../1-linux-image-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-13T16:57:30.173 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T16:57:30.599 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-135-generic. 2021-02-13T16:57:30.602 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-13T16:57:30.641 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking linux-modules-extra-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T16:57:33.061 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../3-linux-generic_4.15.0.135.122_amd64.deb ... 2021-02-13T16:57:33.191 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking linux-generic (4.15.0.135.122) over (4.15.0.122.109) ... 2021-02-13T16:57:33.489 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.135.122_amd64.deb ... 2021-02-13T16:57:33.594 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking linux-image-generic (4.15.0.135.122) over (4.15.0.122.109) ... 2021-02-13T16:57:33.872 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package linux-headers-4.15.0-135. 2021-02-13T16:57:33.875 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../5-linux-headers-4.15.0-135_4.15.0-135.139_all.deb ... 2021-02-13T16:57:33.914 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking linux-headers-4.15.0-135 (4.15.0-135.139) ... 2021-02-13T16:57:36.314 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package linux-headers-4.15.0-135-generic. 2021-02-13T16:57:36.322 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../6-linux-headers-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-13T16:57:36.365 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking linux-headers-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T16:57:37.660 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.135.122_amd64.deb ... 2021-02-13T16:57:37.787 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking linux-headers-generic (4.15.0.135.122) over (4.15.0.122.109) ... 2021-02-13T16:57:38.083 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up linux-modules-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T16:57:38.490 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up linux-headers-4.15.0-135 (4.15.0-135.139) ... 2021-02-13T16:57:38.591 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T16:57:38.888 INFO:teuthology.orchestra.run.gibba037.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-135-generic 2021-02-13T16:57:38.888 INFO:teuthology.orchestra.run.gibba037.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-135-generic 2021-02-13T16:57:38.993 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up linux-modules-extra-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T16:57:39.362 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up linux-headers-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T16:57:39.488 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up linux-image-generic (4.15.0.135.122) ... 2021-02-13T16:57:39.605 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up linux-headers-generic (4.15.0.135.122) ... 2021-02-13T16:57:39.732 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up linux-generic (4.15.0.135.122) ... 2021-02-13T16:57:39.858 INFO:teuthology.orchestra.run.gibba037.stdout:Processing triggers for linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T16:57:39.998 INFO:teuthology.orchestra.run.gibba037.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-02-13T16:57:39.998 INFO:teuthology.orchestra.run.gibba037.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-135-generic 2021-02-13T16:57:48.929 INFO:teuthology.orchestra.run.gibba037.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-02-13T16:57:48.930 INFO:teuthology.orchestra.run.gibba037.stdout:Sourcing file `/etc/default/grub' 2021-02-13T16:57:48.961 INFO:teuthology.orchestra.run.gibba037.stdout:Generating grub configuration file ... 2021-02-13T16:57:49.252 INFO:teuthology.orchestra.run.gibba037.stdout:Found linux image: /boot/vmlinuz-4.15.0-135-generic 2021-02-13T16:57:49.276 INFO:teuthology.orchestra.run.gibba037.stdout:Found initrd image: /boot/initrd.img-4.15.0-135-generic 2021-02-13T16:57:49.508 INFO:teuthology.orchestra.run.gibba037.stdout:Found linux image: /boot/vmlinuz-4.15.0-122-generic 2021-02-13T16:57:49.543 INFO:teuthology.orchestra.run.gibba037.stdout:Found initrd image: /boot/initrd.img-4.15.0-122-generic 2021-02-13T16:57:50.247 INFO:teuthology.orchestra.run.gibba037.stdout:done 2021-02-13T16:57:50.569 DEBUG:teuthology.orchestra.run.gibba037:> dpkg -s linux-image-generic 2021-02-13T16:57:50.581 INFO:teuthology.orchestra.run.gibba037.stdout:Package: linux-image-generic 2021-02-13T16:57:50.581 INFO:teuthology.orchestra.run.gibba037.stdout:Status: install ok installed 2021-02-13T16:57:50.581 INFO:teuthology.orchestra.run.gibba037.stdout:Priority: optional 2021-02-13T16:57:50.581 INFO:teuthology.orchestra.run.gibba037.stdout:Section: kernel 2021-02-13T16:57:50.581 INFO:teuthology.orchestra.run.gibba037.stdout:Installed-Size: 17 2021-02-13T16:57:50.581 INFO:teuthology.orchestra.run.gibba037.stdout:Maintainer: Ubuntu Kernel Team 2021-02-13T16:57:50.581 INFO:teuthology.orchestra.run.gibba037.stdout:Architecture: amd64 2021-02-13T16:57:50.581 INFO:teuthology.orchestra.run.gibba037.stdout:Source: linux-meta 2021-02-13T16:57:50.581 INFO:teuthology.orchestra.run.gibba037.stdout:Version: 4.15.0.135.122 2021-02-13T16:57:50.582 INFO:teuthology.orchestra.run.gibba037.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-02-13T16:57:50.582 INFO:teuthology.orchestra.run.gibba037.stdout:Depends: linux-image-4.15.0-135-generic, linux-modules-extra-4.15.0-135-generic, linux-firmware, intel-microcode, amd64-microcode 2021-02-13T16:57:50.582 INFO:teuthology.orchestra.run.gibba037.stdout:Recommends: thermald 2021-02-13T16:57:50.582 INFO:teuthology.orchestra.run.gibba037.stdout:Description: Generic Linux kernel image 2021-02-13T16:57:50.582 INFO:teuthology.orchestra.run.gibba037.stdout: This package will always depend on the latest generic kernel image 2021-02-13T16:57:50.582 INFO:teuthology.orchestra.run.gibba037.stdout: available. 2021-02-13T16:57:50.583 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-122-generic Expected: 4.15.0-135-generic 2021-02-13T16:57:50.583 DEBUG:teuthology.orchestra.run.gibba038:> uname -r 2021-02-13T16:57:50.591 INFO:teuthology.orchestra.run.gibba038.stdout:4.15.0-122-generic 2021-02-13T16:57:50.592 INFO:teuthology.task.kernel:Running kernel on gibba038: 4.15.0-122-generic 2021-02-13T16:57:50.592 DEBUG:teuthology.orchestra.run.gibba038:> sudo apt-get clean 2021-02-13T16:57:50.675 DEBUG:teuthology.orchestra.run.gibba038:> sudo apt-get update 2021-02-13T16:57:50.857 INFO:teuthology.orchestra.run.gibba038.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-02-13T16:57:50.976 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-13T16:57:51.049 INFO:teuthology.orchestra.run.gibba038.stdout:Get:3 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [916 kB] 2021-02-13T16:57:51.057 INFO:teuthology.orchestra.run.gibba038.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-02-13T16:57:51.152 INFO:teuthology.orchestra.run.gibba038.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,544 kB] 2021-02-13T16:57:51.180 INFO:teuthology.orchestra.run.gibba038.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [298 kB] 2021-02-13T16:57:51.182 INFO:teuthology.orchestra.run.gibba038.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [226 kB] 2021-02-13T16:57:51.184 INFO:teuthology.orchestra.run.gibba038.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted i386 Packages [13.5 kB] 2021-02-13T16:57:51.184 INFO:teuthology.orchestra.run.gibba038.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [29.9 kB] 2021-02-13T16:57:51.185 INFO:teuthology.orchestra.run.gibba038.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [975 kB] 2021-02-13T16:57:51.197 INFO:teuthology.orchestra.run.gibba038.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,109 kB] 2021-02-13T16:57:51.208 INFO:teuthology.orchestra.run.gibba038.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [248 kB] 2021-02-13T16:57:51.209 INFO:teuthology.orchestra.run.gibba038.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [9,208 B] 2021-02-13T16:57:51.209 INFO:teuthology.orchestra.run.gibba038.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [26.0 kB] 2021-02-13T16:57:51.210 INFO:teuthology.orchestra.run.gibba038.stdout:Get:15 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [5,272 B] 2021-02-13T16:57:51.330 INFO:teuthology.orchestra.run.gibba038.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-02-13T16:57:51.427 INFO:teuthology.orchestra.run.gibba038.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,220 kB] 2021-02-13T16:57:51.696 INFO:teuthology.orchestra.run.gibba038.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,884 kB] 2021-02-13T16:57:51.802 INFO:teuthology.orchestra.run.gibba038.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [390 kB] 2021-02-13T16:57:51.818 INFO:teuthology.orchestra.run.gibba038.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [247 kB] 2021-02-13T16:57:51.827 INFO:teuthology.orchestra.run.gibba038.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [20.2 kB] 2021-02-13T16:57:51.827 INFO:teuthology.orchestra.run.gibba038.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [33.4 kB] 2021-02-13T16:57:51.828 INFO:teuthology.orchestra.run.gibba038.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,560 kB] 2021-02-13T16:57:51.862 INFO:teuthology.orchestra.run.gibba038.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,718 kB] 2021-02-13T16:57:51.919 INFO:teuthology.orchestra.run.gibba038.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [363 kB] 2021-02-13T16:57:51.924 INFO:teuthology.orchestra.run.gibba038.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [31.8 kB] 2021-02-13T16:57:51.924 INFO:teuthology.orchestra.run.gibba038.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [14.3 kB] 2021-02-13T16:57:51.924 INFO:teuthology.orchestra.run.gibba038.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [7,300 B] 2021-02-13T16:57:52.602 INFO:teuthology.orchestra.run.gibba038.stdout:Fetched 13.1 MB in 2s (7,876 kB/s) 2021-02-13T16:57:53.740 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-02-13T16:57:53.766 DEBUG:teuthology.orchestra.run.gibba038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-02-13T16:57:53.811 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-02-13T16:57:53.982 INFO:teuthology.orchestra.run.gibba038.stdout:Building dependency tree... 2021-02-13T16:57:53.982 INFO:teuthology.orchestra.run.gibba038.stdout:Reading state information... 2021-02-13T16:57:54.033 INFO:teuthology.orchestra.run.gibba038.stderr:E: Unable to locate package linux-image-current-generic 2021-02-13T16:57:54.034 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-02-13T16:57:54.034 DEBUG:teuthology.orchestra.run.gibba038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-02-13T16:57:54.132 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-02-13T16:57:54.304 INFO:teuthology.orchestra.run.gibba038.stdout:Building dependency tree... 2021-02-13T16:57:54.304 INFO:teuthology.orchestra.run.gibba038.stdout:Reading state information... 2021-02-13T16:57:54.404 INFO:teuthology.orchestra.run.gibba038.stdout:The following additional packages will be installed: 2021-02-13T16:57:54.404 INFO:teuthology.orchestra.run.gibba038.stdout: linux-generic linux-headers-4.15.0-135 linux-headers-4.15.0-135-generic 2021-02-13T16:57:54.404 INFO:teuthology.orchestra.run.gibba038.stdout: linux-headers-generic linux-image-4.15.0-135-generic 2021-02-13T16:57:54.404 INFO:teuthology.orchestra.run.gibba038.stdout: linux-modules-4.15.0-135-generic linux-modules-extra-4.15.0-135-generic 2021-02-13T16:57:54.404 INFO:teuthology.orchestra.run.gibba038.stdout:Suggested packages: 2021-02-13T16:57:54.405 INFO:teuthology.orchestra.run.gibba038.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2021-02-13T16:57:54.405 INFO:teuthology.orchestra.run.gibba038.stdout:Recommended packages: 2021-02-13T16:57:54.405 INFO:teuthology.orchestra.run.gibba038.stdout: thermald 2021-02-13T16:57:54.420 INFO:teuthology.orchestra.run.gibba038.stdout:The following NEW packages will be installed: 2021-02-13T16:57:54.420 INFO:teuthology.orchestra.run.gibba038.stdout: linux-headers-4.15.0-135 linux-headers-4.15.0-135-generic 2021-02-13T16:57:54.420 INFO:teuthology.orchestra.run.gibba038.stdout: linux-image-4.15.0-135-generic linux-modules-4.15.0-135-generic 2021-02-13T16:57:54.420 INFO:teuthology.orchestra.run.gibba038.stdout: linux-modules-extra-4.15.0-135-generic 2021-02-13T16:57:54.420 INFO:teuthology.orchestra.run.gibba038.stdout:The following packages will be upgraded: 2021-02-13T16:57:54.420 INFO:teuthology.orchestra.run.gibba038.stdout: linux-generic linux-headers-generic linux-image-generic 2021-02-13T16:57:54.587 INFO:teuthology.orchestra.run.gibba038.stdout:3 upgraded, 5 newly installed, 0 to remove and 88 not upgraded. 2021-02-13T16:57:54.587 INFO:teuthology.orchestra.run.gibba038.stdout:Need to get 66.0 MB of archives. 2021-02-13T16:57:54.587 INFO:teuthology.orchestra.run.gibba038.stdout:After this operation, 334 MB of additional disk space will be used. 2021-02-13T16:57:54.587 INFO:teuthology.orchestra.run.gibba038.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-135-generic amd64 4.15.0-135.139 [13.1 MB] 2021-02-13T16:57:55.582 INFO:teuthology.orchestra.run.gibba038.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-135-generic amd64 4.15.0-135.139 [8,019 kB] 2021-02-13T16:57:55.815 INFO:teuthology.orchestra.run.gibba038.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-135-generic amd64 4.15.0-135.139 [32.8 MB] 2021-02-13T16:57:56.710 INFO:teuthology.orchestra.run.gibba038.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.135.122 [1,868 B] 2021-02-13T16:57:56.711 INFO:teuthology.orchestra.run.gibba038.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.135.122 [2,592 B] 2021-02-13T16:57:56.711 INFO:teuthology.orchestra.run.gibba038.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-135 all 4.15.0-135.139 [10.9 MB] 2021-02-13T16:57:57.019 INFO:teuthology.orchestra.run.gibba038.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-135-generic amd64 4.15.0-135.139 [1,097 kB] 2021-02-13T16:57:57.036 INFO:teuthology.orchestra.run.gibba038.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.135.122 [2,488 B] 2021-02-13T16:57:57.343 INFO:teuthology.orchestra.run.gibba038.stdout:Fetched 66.0 MB in 3s (25.3 MB/s) 2021-02-13T16:57:57.459 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package linux-modules-4.15.0-135-generic. 2021-02-13T16:57:57.476 INFO:teuthology.orchestra.run.gibba038.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102071 files and directories currently installed.) 2021-02-13T16:57:57.477 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../0-linux-modules-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-13T16:57:57.516 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-modules-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T16:57:58.740 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package linux-image-4.15.0-135-generic. 2021-02-13T16:57:58.880 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../1-linux-image-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-13T16:57:58.880 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T16:57:59.244 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-135-generic. 2021-02-13T16:57:59.247 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-13T16:57:59.285 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-modules-extra-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T16:58:01.813 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../3-linux-generic_4.15.0.135.122_amd64.deb ... 2021-02-13T16:58:01.928 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-generic (4.15.0.135.122) over (4.15.0.122.109) ... 2021-02-13T16:58:02.229 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.135.122_amd64.deb ... 2021-02-13T16:58:02.357 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-image-generic (4.15.0.135.122) over (4.15.0.122.109) ... 2021-02-13T16:58:02.700 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package linux-headers-4.15.0-135. 2021-02-13T16:58:02.704 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../5-linux-headers-4.15.0-135_4.15.0-135.139_all.deb ... 2021-02-13T16:58:02.742 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-headers-4.15.0-135 (4.15.0-135.139) ... 2021-02-13T16:58:05.077 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package linux-headers-4.15.0-135-generic. 2021-02-13T16:58:05.085 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../6-linux-headers-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-13T16:58:05.119 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-headers-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T16:58:06.407 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.135.122_amd64.deb ... 2021-02-13T16:58:06.534 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-headers-generic (4.15.0.135.122) over (4.15.0.122.109) ... 2021-02-13T16:58:06.825 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-modules-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T16:58:07.229 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-headers-4.15.0-135 (4.15.0-135.139) ... 2021-02-13T16:58:07.330 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T16:58:07.631 INFO:teuthology.orchestra.run.gibba038.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-135-generic 2021-02-13T16:58:07.632 INFO:teuthology.orchestra.run.gibba038.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-135-generic 2021-02-13T16:58:07.758 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-modules-extra-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T16:58:08.118 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-headers-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T16:58:08.244 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-image-generic (4.15.0.135.122) ... 2021-02-13T16:58:08.353 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-headers-generic (4.15.0.135.122) ... 2021-02-13T16:58:08.454 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-generic (4.15.0.135.122) ... 2021-02-13T16:58:08.579 INFO:teuthology.orchestra.run.gibba038.stdout:Processing triggers for linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T16:58:08.702 INFO:teuthology.orchestra.run.gibba038.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-02-13T16:58:08.702 INFO:teuthology.orchestra.run.gibba038.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-135-generic 2021-02-13T16:58:17.715 INFO:teuthology.orchestra.run.gibba038.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-02-13T16:58:17.715 INFO:teuthology.orchestra.run.gibba038.stdout:Sourcing file `/etc/default/grub' 2021-02-13T16:58:17.756 INFO:teuthology.orchestra.run.gibba038.stdout:Generating grub configuration file ... 2021-02-13T16:58:18.103 INFO:teuthology.orchestra.run.gibba038.stdout:Found linux image: /boot/vmlinuz-4.15.0-135-generic 2021-02-13T16:58:18.160 INFO:teuthology.orchestra.run.gibba038.stdout:Found initrd image: /boot/initrd.img-4.15.0-135-generic 2021-02-13T16:58:18.548 INFO:teuthology.orchestra.run.gibba038.stdout:Found linux image: /boot/vmlinuz-4.15.0-122-generic 2021-02-13T16:58:18.591 INFO:teuthology.orchestra.run.gibba038.stdout:Found initrd image: /boot/initrd.img-4.15.0-122-generic 2021-02-13T16:58:19.755 INFO:teuthology.orchestra.run.gibba038.stdout:done 2021-02-13T16:58:20.114 DEBUG:teuthology.orchestra.run.gibba038:> dpkg -s linux-image-generic 2021-02-13T16:58:20.126 INFO:teuthology.orchestra.run.gibba038.stdout:Package: linux-image-generic 2021-02-13T16:58:20.126 INFO:teuthology.orchestra.run.gibba038.stdout:Status: install ok installed 2021-02-13T16:58:20.126 INFO:teuthology.orchestra.run.gibba038.stdout:Priority: optional 2021-02-13T16:58:20.127 INFO:teuthology.orchestra.run.gibba038.stdout:Section: kernel 2021-02-13T16:58:20.127 INFO:teuthology.orchestra.run.gibba038.stdout:Installed-Size: 17 2021-02-13T16:58:20.127 INFO:teuthology.orchestra.run.gibba038.stdout:Maintainer: Ubuntu Kernel Team 2021-02-13T16:58:20.127 INFO:teuthology.orchestra.run.gibba038.stdout:Architecture: amd64 2021-02-13T16:58:20.127 INFO:teuthology.orchestra.run.gibba038.stdout:Source: linux-meta 2021-02-13T16:58:20.127 INFO:teuthology.orchestra.run.gibba038.stdout:Version: 4.15.0.135.122 2021-02-13T16:58:20.127 INFO:teuthology.orchestra.run.gibba038.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-02-13T16:58:20.127 INFO:teuthology.orchestra.run.gibba038.stdout:Depends: linux-image-4.15.0-135-generic, linux-modules-extra-4.15.0-135-generic, linux-firmware, intel-microcode, amd64-microcode 2021-02-13T16:58:20.127 INFO:teuthology.orchestra.run.gibba038.stdout:Recommends: thermald 2021-02-13T16:58:20.127 INFO:teuthology.orchestra.run.gibba038.stdout:Description: Generic Linux kernel image 2021-02-13T16:58:20.127 INFO:teuthology.orchestra.run.gibba038.stdout: This package will always depend on the latest generic kernel image 2021-02-13T16:58:20.127 INFO:teuthology.orchestra.run.gibba038.stdout: available. 2021-02-13T16:58:20.128 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-122-generic Expected: 4.15.0-135-generic 2021-02-13T16:58:20.128 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-02-13T16:58:20.128 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-02-13T16:58:20.128 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-02-13T16:58:20.128 INFO:teuthology.task.kernel:Installing distro kernel on c1.mon.a... 2021-02-13T16:58:20.128 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba037.front.sepia.ceph.com, path=None, version=distro) 2021-02-13T16:58:20.128 DEBUG:teuthology.orchestra.run.gibba037:> sudo apt-get clean 2021-02-13T16:58:20.160 DEBUG:teuthology.orchestra.run.gibba037:> sudo apt-get update 2021-02-13T16:58:20.297 INFO:teuthology.orchestra.run.gibba037.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-02-13T16:58:20.410 INFO:teuthology.orchestra.run.gibba037.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-13T16:58:20.489 INFO:teuthology.orchestra.run.gibba037.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-02-13T16:58:20.568 INFO:teuthology.orchestra.run.gibba037.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-02-13T16:58:21.558 INFO:teuthology.orchestra.run.gibba037.stdout:Reading package lists... 2021-02-13T16:58:21.585 DEBUG:teuthology.orchestra.run.gibba037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-02-13T16:58:21.636 INFO:teuthology.orchestra.run.gibba037.stdout:Reading package lists... 2021-02-13T16:58:21.833 INFO:teuthology.orchestra.run.gibba037.stdout:Building dependency tree... 2021-02-13T16:58:21.833 INFO:teuthology.orchestra.run.gibba037.stdout:Reading state information... 2021-02-13T16:58:21.895 INFO:teuthology.orchestra.run.gibba037.stderr:E: Unable to locate package linux-image-current-generic 2021-02-13T16:58:21.896 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-02-13T16:58:21.896 DEBUG:teuthology.orchestra.run.gibba037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-02-13T16:58:21.984 INFO:teuthology.orchestra.run.gibba037.stdout:Reading package lists... 2021-02-13T16:58:22.156 INFO:teuthology.orchestra.run.gibba037.stdout:Building dependency tree... 2021-02-13T16:58:22.157 INFO:teuthology.orchestra.run.gibba037.stdout:Reading state information... 2021-02-13T16:58:22.275 INFO:teuthology.orchestra.run.gibba037.stdout:linux-image-generic is already the newest version (4.15.0.135.122). 2021-02-13T16:58:22.275 INFO:teuthology.orchestra.run.gibba037.stdout:0 upgraded, 0 newly installed, 0 to remove and 88 not upgraded. 2021-02-13T16:58:22.276 DEBUG:teuthology.orchestra.run.gibba037:> dpkg -s linux-image-generic 2021-02-13T16:58:22.330 INFO:teuthology.orchestra.run.gibba037.stdout:Package: linux-image-generic 2021-02-13T16:58:22.330 INFO:teuthology.orchestra.run.gibba037.stdout:Status: install ok installed 2021-02-13T16:58:22.330 INFO:teuthology.orchestra.run.gibba037.stdout:Priority: optional 2021-02-13T16:58:22.330 INFO:teuthology.orchestra.run.gibba037.stdout:Section: kernel 2021-02-13T16:58:22.330 INFO:teuthology.orchestra.run.gibba037.stdout:Installed-Size: 17 2021-02-13T16:58:22.330 INFO:teuthology.orchestra.run.gibba037.stdout:Maintainer: Ubuntu Kernel Team 2021-02-13T16:58:22.330 INFO:teuthology.orchestra.run.gibba037.stdout:Architecture: amd64 2021-02-13T16:58:22.330 INFO:teuthology.orchestra.run.gibba037.stdout:Source: linux-meta 2021-02-13T16:58:22.331 INFO:teuthology.orchestra.run.gibba037.stdout:Version: 4.15.0.135.122 2021-02-13T16:58:22.331 INFO:teuthology.orchestra.run.gibba037.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-02-13T16:58:22.331 INFO:teuthology.orchestra.run.gibba037.stdout:Depends: linux-image-4.15.0-135-generic, linux-modules-extra-4.15.0-135-generic, linux-firmware, intel-microcode, amd64-microcode 2021-02-13T16:58:22.331 INFO:teuthology.orchestra.run.gibba037.stdout:Recommends: thermald 2021-02-13T16:58:22.331 INFO:teuthology.orchestra.run.gibba037.stdout:Description: Generic Linux kernel image 2021-02-13T16:58:22.331 INFO:teuthology.orchestra.run.gibba037.stdout: This package will always depend on the latest generic kernel image 2021-02-13T16:58:22.331 INFO:teuthology.orchestra.run.gibba037.stdout: available. 2021-02-13T16:58:22.331 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-02-13T16:58:22.374 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.9158VftzDq 2021-02-13T16:58:22.374 DEBUG:teuthology.orchestra.run.gibba037:> sudo cp /boot/grub/grub.cfg /tmp/tmp.9158VftzDq 2021-02-13T16:58:22.425 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.9158VftzDq 2021-02-13T16:58:22.533 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.9158VftzDq is 8KB 2021-02-13T16:58:22.581 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.9158VftzDq 2021-02-13T16:58:22.585 DEBUG:teuthology.orchestra.run.gibba037:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-02-13T16:58:22.629 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-02-13T16:58:22.630 DEBUG:teuthology.orchestra.run.gibba037:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-02-13T16:58:22.630 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-02-13T16:58:22.695 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-135-generic 2021-02-13T16:58:22.696 DEBUG:teuthology.orchestra.run.gibba037:> sudo update-grub 2021-02-13T16:58:23.880 INFO:teuthology.orchestra.run.gibba037.stderr:Sourcing file `/etc/default/grub' 2021-02-13T16:58:23.913 INFO:teuthology.orchestra.run.gibba037.stderr:Generating grub configuration file ... 2021-02-13T16:58:24.161 INFO:teuthology.orchestra.run.gibba037.stderr:Found linux image: /boot/vmlinuz-4.15.0-135-generic 2021-02-13T16:58:24.177 INFO:teuthology.orchestra.run.gibba037.stderr:Found initrd image: /boot/initrd.img-4.15.0-135-generic 2021-02-13T16:58:24.541 INFO:teuthology.orchestra.run.gibba037.stderr:Found linux image: /boot/vmlinuz-4.15.0-122-generic 2021-02-13T16:58:24.557 INFO:teuthology.orchestra.run.gibba037.stderr:Found initrd image: /boot/initrd.img-4.15.0-122-generic 2021-02-13T16:58:25.345 INFO:teuthology.orchestra.run.gibba037.stderr:done 2021-02-13T16:58:25.347 DEBUG:teuthology.orchestra.run.gibba037:> sudo shutdown -r now 2021-02-13T16:58:25.349 INFO:teuthology.task.kernel:Installing distro kernel on c2.mon.a... 2021-02-13T16:58:25.349 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba038.front.sepia.ceph.com, path=None, version=distro) 2021-02-13T16:58:25.349 DEBUG:teuthology.orchestra.run.gibba038:> sudo apt-get clean 2021-02-13T16:58:25.404 DEBUG:teuthology.orchestra.run.gibba038:> sudo apt-get update 2021-02-13T16:58:25.608 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-02-13T16:58:25.608 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-13T16:58:25.682 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-02-13T16:58:25.761 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-02-13T16:58:26.817 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-02-13T16:58:26.844 DEBUG:teuthology.orchestra.run.gibba038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-02-13T16:58:26.892 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-02-13T16:58:27.059 INFO:teuthology.orchestra.run.gibba038.stdout:Building dependency tree... 2021-02-13T16:58:27.060 INFO:teuthology.orchestra.run.gibba038.stdout:Reading state information... 2021-02-13T16:58:27.109 INFO:teuthology.orchestra.run.gibba038.stderr:E: Unable to locate package linux-image-current-generic 2021-02-13T16:58:27.110 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-02-13T16:58:27.110 DEBUG:teuthology.orchestra.run.gibba038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-02-13T16:58:27.197 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-02-13T16:58:27.360 INFO:teuthology.orchestra.run.gibba038.stdout:Building dependency tree... 2021-02-13T16:58:27.360 INFO:teuthology.orchestra.run.gibba038.stdout:Reading state information... 2021-02-13T16:58:27.468 INFO:teuthology.orchestra.run.gibba038.stdout:linux-image-generic is already the newest version (4.15.0.135.122). 2021-02-13T16:58:27.468 INFO:teuthology.orchestra.run.gibba038.stdout:0 upgraded, 0 newly installed, 0 to remove and 88 not upgraded. 2021-02-13T16:58:27.469 DEBUG:teuthology.orchestra.run.gibba038:> dpkg -s linux-image-generic 2021-02-13T16:58:27.524 INFO:teuthology.orchestra.run.gibba038.stdout:Package: linux-image-generic 2021-02-13T16:58:27.524 INFO:teuthology.orchestra.run.gibba038.stdout:Status: install ok installed 2021-02-13T16:58:27.524 INFO:teuthology.orchestra.run.gibba038.stdout:Priority: optional 2021-02-13T16:58:27.525 INFO:teuthology.orchestra.run.gibba038.stdout:Section: kernel 2021-02-13T16:58:27.525 INFO:teuthology.orchestra.run.gibba038.stdout:Installed-Size: 17 2021-02-13T16:58:27.525 INFO:teuthology.orchestra.run.gibba038.stdout:Maintainer: Ubuntu Kernel Team 2021-02-13T16:58:27.525 INFO:teuthology.orchestra.run.gibba038.stdout:Architecture: amd64 2021-02-13T16:58:27.525 INFO:teuthology.orchestra.run.gibba038.stdout:Source: linux-meta 2021-02-13T16:58:27.525 INFO:teuthology.orchestra.run.gibba038.stdout:Version: 4.15.0.135.122 2021-02-13T16:58:27.525 INFO:teuthology.orchestra.run.gibba038.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-02-13T16:58:27.525 INFO:teuthology.orchestra.run.gibba038.stdout:Depends: linux-image-4.15.0-135-generic, linux-modules-extra-4.15.0-135-generic, linux-firmware, intel-microcode, amd64-microcode 2021-02-13T16:58:27.525 INFO:teuthology.orchestra.run.gibba038.stdout:Recommends: thermald 2021-02-13T16:58:27.525 INFO:teuthology.orchestra.run.gibba038.stdout:Description: Generic Linux kernel image 2021-02-13T16:58:27.525 INFO:teuthology.orchestra.run.gibba038.stdout: This package will always depend on the latest generic kernel image 2021-02-13T16:58:27.525 INFO:teuthology.orchestra.run.gibba038.stdout: available. 2021-02-13T16:58:27.526 DEBUG:teuthology.orchestra.run.gibba038:> mktemp 2021-02-13T16:58:27.569 INFO:teuthology.orchestra.run.gibba038.stdout:/tmp/tmp.Qr2PGmLF0Z 2021-02-13T16:58:27.569 DEBUG:teuthology.orchestra.run.gibba038:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Qr2PGmLF0Z 2021-02-13T16:58:27.624 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 0666 /tmp/tmp.Qr2PGmLF0Z 2021-02-13T16:58:27.736 DEBUG:teuthology.orchestra.remote:gibba038:/tmp/tmp.Qr2PGmLF0Z is 8KB 2021-02-13T16:58:27.750 DEBUG:teuthology.orchestra.run.gibba038:> rm -fr /tmp/tmp.Qr2PGmLF0Z 2021-02-13T16:58:27.754 DEBUG:teuthology.orchestra.run.gibba038:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-02-13T16:58:27.801 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-02-13T16:58:27.801 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-02-13T16:58:27.801 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-02-13T16:58:27.866 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-135-generic 2021-02-13T16:58:27.866 DEBUG:teuthology.orchestra.run.gibba038:> sudo update-grub 2021-02-13T16:58:28.944 INFO:teuthology.orchestra.run.gibba038.stderr:Sourcing file `/etc/default/grub' 2021-02-13T16:58:28.972 INFO:teuthology.orchestra.run.gibba038.stderr:Generating grub configuration file ... 2021-02-13T16:58:29.205 INFO:teuthology.orchestra.run.gibba038.stderr:Found linux image: /boot/vmlinuz-4.15.0-135-generic 2021-02-13T16:58:29.221 INFO:teuthology.orchestra.run.gibba038.stderr:Found initrd image: /boot/initrd.img-4.15.0-135-generic 2021-02-13T16:58:29.563 INFO:teuthology.orchestra.run.gibba038.stderr:Found linux image: /boot/vmlinuz-4.15.0-122-generic 2021-02-13T16:58:29.579 INFO:teuthology.orchestra.run.gibba038.stderr:Found initrd image: /boot/initrd.img-4.15.0-122-generic 2021-02-13T16:58:30.396 INFO:teuthology.orchestra.run.gibba038.stderr:done 2021-02-13T16:58:30.398 DEBUG:teuthology.orchestra.run.gibba038:> sudo shutdown -r now 2021-02-13T16:59:00.430 INFO:teuthology.misc:Re-opening connections... 2021-02-13T16:59:00.430 INFO:teuthology.misc:trying to connect to ubuntu@gibba037.front.sepia.ceph.com 2021-02-13T16:59:00.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T16:59:00.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T16:59:18.854 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.137 2021-02-13T16:59:18.854 INFO:teuthology.misc:trying to connect to ubuntu@gibba038.front.sepia.ceph.com 2021-02-13T16:59:18.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T16:59:18.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T16:59:37.282 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.138 2021-02-13T16:59:37.283 DEBUG:teuthology.misc:waited 36.8521888256073 2021-02-13T16:59:38.283 INFO:teuthology.misc:trying to connect to ubuntu@gibba037.front.sepia.ceph.com 2021-02-13T16:59:38.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T16:59:38.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T16:59:41.346 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.137 2021-02-13T16:59:41.347 INFO:teuthology.misc:trying to connect to ubuntu@gibba038.front.sepia.ceph.com 2021-02-13T16:59:41.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T16:59:41.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T16:59:44.422 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.138 2021-02-13T16:59:44.422 DEBUG:teuthology.misc:waited 43.991995334625244 2021-02-13T16:59:45.423 INFO:teuthology.misc:trying to connect to ubuntu@gibba037.front.sepia.ceph.com 2021-02-13T16:59:45.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T16:59:45.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:00:16.963 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.137 2021-02-13T17:00:16.963 INFO:teuthology.misc:trying to connect to ubuntu@gibba038.front.sepia.ceph.com 2021-02-13T17:00:16.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T17:00:16.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:00:17.986 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.138 2021-02-13T17:00:17.987 DEBUG:teuthology.misc:waited 77.55639219284058 2021-02-13T17:00:18.987 INFO:teuthology.misc:trying to connect to ubuntu@gibba037.front.sepia.ceph.com 2021-02-13T17:00:18.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T17:00:18.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:00:19.196 DEBUG:teuthology.orchestra.run.gibba037:> true 2021-02-13T17:00:20.201 DEBUG:teuthology.misc:waited 79.77017283439636 2021-02-13T17:00:21.202 INFO:teuthology.misc:trying to connect to ubuntu@gibba038.front.sepia.ceph.com 2021-02-13T17:00:21.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T17:00:21.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:00:21.204 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.138 2021-02-13T17:00:21.204 DEBUG:teuthology.misc:waited 80.77338480949402 2021-02-13T17:00:22.205 INFO:teuthology.misc:trying to connect to ubuntu@gibba038.front.sepia.ceph.com 2021-02-13T17:00:22.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T17:00:22.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:00:22.207 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.138 2021-02-13T17:00:22.207 DEBUG:teuthology.misc:waited 81.77648520469666 2021-02-13T17:00:23.208 INFO:teuthology.misc:trying to connect to ubuntu@gibba038.front.sepia.ceph.com 2021-02-13T17:00:23.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T17:00:23.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:00:23.210 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.138 2021-02-13T17:00:23.210 DEBUG:teuthology.misc:waited 82.77932739257812 2021-02-13T17:00:24.212 INFO:teuthology.misc:trying to connect to ubuntu@gibba038.front.sepia.ceph.com 2021-02-13T17:00:24.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T17:00:24.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:00:24.356 DEBUG:teuthology.orchestra.run.gibba038:> true 2021-02-13T17:00:24.893 DEBUG:teuthology.misc:waited 84.46273469924927 2021-02-13T17:00:25.894 INFO:teuthology.task.kernel:Checking client c1.mon.a for new kernel version... 2021-02-13T17:00:25.895 INFO:teuthology.task.kernel:Checking kernel version of c1.mon.a, want "4.15.0-135-generic"... 2021-02-13T17:00:25.895 DEBUG:teuthology.orchestra.run.gibba037:> uname -r 2021-02-13T17:00:25.903 INFO:teuthology.orchestra.run.gibba037.stdout:4.15.0-135-generic 2021-02-13T17:00:25.904 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-135-generic vs 4.15.0-135-generic 2021-02-13T17:00:25.904 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-02-13T17:00:25.904 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-02-13T17:00:25.904 INFO:teuthology.task.kernel:Checking client c2.mon.a for new kernel version... 2021-02-13T17:00:25.904 INFO:teuthology.task.kernel:Checking kernel version of c2.mon.a, want "4.15.0-135-generic"... 2021-02-13T17:00:25.904 DEBUG:teuthology.orchestra.run.gibba038:> uname -r 2021-02-13T17:00:25.907 INFO:teuthology.orchestra.run.gibba038.stdout:4.15.0-135-generic 2021-02-13T17:00:25.908 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-135-generic vs 4.15.0-135-generic 2021-02-13T17:00:25.908 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-02-13T17:00:25.908 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-02-13T17:00:26.908 INFO:teuthology.task.kernel:Enabling kdb on c1.mon.a... 2021-02-13T17:00:26.909 DEBUG:teuthology.orchestra.run.gibba037:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-02-13T17:00:26.939 INFO:teuthology.orchestra.run.gibba037.stdout:ttyS1 2021-02-13T17:00:26.960 INFO:teuthology.task.kernel:Enabling kdb on c2.mon.a... 2021-02-13T17:00:26.961 DEBUG:teuthology.orchestra.run.gibba038:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-02-13T17:00:26.990 INFO:teuthology.orchestra.run.gibba038.stdout:ttyS1 2021-02-13T17:00:27.032 INFO:teuthology.run_tasks:Running task internal.base... 2021-02-13T17:00:27.043 INFO:teuthology.task.internal:Creating test directory... 2021-02-13T17:00:27.043 DEBUG:teuthology.orchestra.run.gibba037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-02-13T17:00:27.045 DEBUG:teuthology.orchestra.run.gibba038:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-02-13T17:00:27.082 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-02-13T17:00:27.092 INFO:teuthology.run_tasks:Running task internal.archive... 2021-02-13T17:00:27.117 INFO:teuthology.task.internal:Creating archive directory... 2021-02-13T17:00:27.117 DEBUG:teuthology.orchestra.run.gibba037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-02-13T17:00:27.119 DEBUG:teuthology.orchestra.run.gibba038:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-02-13T17:00:27.142 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-02-13T17:00:27.159 INFO:teuthology.task.internal:Enabling coredump saving... 2021-02-13T17:00:27.159 DEBUG:teuthology.orchestra.run.gibba037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-02-13T17:00:27.173 DEBUG:teuthology.orchestra.run.gibba038:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-02-13T17:00:27.179 INFO:teuthology.orchestra.run.gibba037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-13T17:00:27.182 INFO:teuthology.orchestra.run.gibba037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-13T17:00:27.199 INFO:teuthology.orchestra.run.gibba038.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-13T17:00:27.207 INFO:teuthology.orchestra.run.gibba038.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-13T17:00:27.208 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-02-13T17:00:27.219 INFO:teuthology.task.internal:Configuring sudo... 2021-02-13T17:00:27.219 DEBUG:teuthology.orchestra.run.gibba037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-02-13T17:00:27.225 DEBUG:teuthology.orchestra.run.gibba038:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-02-13T17:00:27.257 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-02-13T17:00:27.274 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-02-13T17:00:27.275 DEBUG:teuthology.orchestra.run.gibba037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-02-13T17:00:27.277 DEBUG:teuthology.orchestra.run.gibba038:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-02-13T17:00:27.306 DEBUG:teuthology.orchestra.run.gibba037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-13T17:00:27.322 DEBUG:teuthology.orchestra.run.gibba037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-13T17:00:27.366 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-02-13T17:00:27.366 DEBUG:teuthology.orchestra.run.gibba037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-02-13T17:00:27.453 DEBUG:teuthology.orchestra.run.gibba038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-13T17:00:27.462 DEBUG:teuthology.orchestra.run.gibba038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-13T17:00:27.515 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-02-13T17:00:27.515 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-02-13T17:00:27.573 DEBUG:teuthology.orchestra.run.gibba037:> sudo service rsyslog restart 2021-02-13T17:00:27.575 DEBUG:teuthology.orchestra.run.gibba038:> sudo service rsyslog restart 2021-02-13T17:00:27.648 INFO:teuthology.run_tasks:Running task internal.timer... 2021-02-13T17:00:27.660 INFO:teuthology.task.internal:Starting timer... 2021-02-13T17:00:27.660 INFO:teuthology.run_tasks:Running task pcp... 2021-02-13T17:00:27.717 INFO:teuthology.run_tasks:Running task selinux... 2021-02-13T17:00:27.756 DEBUG:teuthology.task.selinux:Excluding gibba037: OS 'ubuntu' does not support SELinux 2021-02-13T17:00:27.756 DEBUG:teuthology.task.selinux:Excluding gibba038: OS 'ubuntu' does not support SELinux 2021-02-13T17:00:27.756 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-02-13T17:00:27.756 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-02-13T17:00:27.757 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-02-13T17:00:27.757 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-02-13T17:00:27.882 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-02-13T17:00:27.882 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-02-13T17:00:27.910 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-02-13T17:00:27.912 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit gibba037.front.sepia.ceph.com,gibba038.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-02-13T17:00:28.285 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-02-13T17:00:29.862 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-02-13T17:00:34.680 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-02-13T17:00:34.713 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:34 +0000 (0:00:00.099) 0:00:00.099 ***** 2021-02-13T17:00:34.727 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:34 +0000 (0:00:00.013) 0:00:00.113 ***** 2021-02-13T17:00:36.388 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba037.front.sepia.ceph.com] 2021-02-13T17:00:36.548 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:36 +0000 (0:00:01.821) 0:00:01.935 ***** 2021-02-13T17:00:36.550 INFO:teuthology.task.ansible.out: 2021-02-13T17:00:36.561 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] 2021-02-13T17:00:36.651 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:36 +0000 (0:00:00.103) 0:00:02.038 ***** 2021-02-13T17:00:36.928 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-02-13T17:00:36.929 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-02-13T17:00:36.997 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:36 +0000 (0:00:00.345) 0:00:02.384 ***** 2021-02-13T17:00:37.006 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-02-13T17:00:37.057 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:37 +0000 (0:00:00.059) 0:00:02.444 ***** 2021-02-13T17:00:37.588 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** changed: [gibba038.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-02-13T17:00:37.631 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:37 +0000 (0:00:00.573) 0:00:03.018 ***** 2021-02-13T17:00:37.645 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-02-13T17:00:37.706 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:37 +0000 (0:00:00.071) 0:00:03.089 ***** 2021-02-13T17:00:38.070 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-02-13T17:00:38.072 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.043724", "end": "2021-02-13 17:00:38.050784", "rc": 0, "start": "2021-02-13 17:00:38.007060", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-02-13T17:00:38.113 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:38 +0000 (0:00:00.410) 0:00:03.499 ***** 2021-02-13T17:00:38.119 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.050986", "end": "2021-02-13 17:00:37.891957", "rc": 0, "start": "2021-02-13 17:00:37.840971", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-02-13T17:00:38.177 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:38 +0000 (0:00:00.064) 0:00:03.564 ***** 2021-02-13T17:00:38.470 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-02-13T17:00:38.472 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-13T17:00:38.518 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:38 +0000 (0:00:00.340) 0:00:03.905 ***** 2021-02-13T17:00:38.531 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-13T17:00:38.608 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:38 +0000 (0:00:00.090) 0:00:03.995 ***** 2021-02-13T17:00:39.401 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613235638.5537674-88480121682312/source", "state": "file", "uid": 0} 2021-02-13T17:00:39.402 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613235638.635198-40273981654033/source", "state": "file", "uid": 0} 2021-02-13T17:00:39.452 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:39 +0000 (0:00:00.842) 0:00:04.838 ***** 2021-02-13T17:00:39.499 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:39 +0000 (0:00:00.047) 0:00:04.885 ***** 2021-02-13T17:00:39.931 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCt 2021-02-13T17:00:39.933 INFO:teuthology.task.ansible.out:oHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-02-13T17:00:39.967 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-02-13T17:00:39.969 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-02-13T17:00:40.140 INFO:teuthology.task.ansible.out: 2021-02-13T17:00:40.141 INFO:teuthology.task.ansible.out:PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-02-13T17:00:40.154 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-02-13T17:00:40.337 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:40 +0000 (0:00:00.838) 0:00:05.724 ***** 2021-02-13T17:00:40.374 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:40 +0000 (0:00:00.036) 0:00:05.760 ***** 2021-02-13T17:00:40.889 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba038.front.sepia.ceph.com] 2021-02-13T17:00:40.978 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-02-13T17:00:40.980 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:40 +0000 (0:00:00.605) 0:00:06.365 ***** 2021-02-13T17:00:41.343 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-02-13T17:00:41.344 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.147603", "end": "2021-02-13 17:00:41.314368", "rc": 0, "start": "2021-02-13 17:00:41.166765", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-02-13T17:00:41.382 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:41 +0000 (0:00:00.402) 0:00:06.768 ***** 2021-02-13T17:00:41.493 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-02-13T17:00:41.494 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.010920", "end": "2021-02-13 17:00:41.304233", "failed_when_result": false, "rc": 0, "start": "2021-02-13 17:00:41.293313", "stderr": "", "stderr_lines": [], "stdout": "e549618f811c1ef59d08997aa55e495f75d8d5e6", "stdout_lines": ["e549618f811c1ef59d08997aa55e495f75d8d5e6"]} 2021-02-13T17:00:41.539 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:41 +0000 (0:00:00.157) 0:00:06.926 ***** 2021-02-13T17:00:41.568 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:00:41.609 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:41 +0000 (0:00:00.069) 0:00:06.995 ***** 2021-02-13T17:00:41.636 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2021-02-13T17:00:41.637 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:00:41.675 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:41 +0000 (0:00:00.067) 0:00:07.062 ***** 2021-02-13T17:00:41.677 INFO:teuthology.task.ansible.out: 2021-02-13T17:00:41.716 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-02-13T17:00:41.718 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:00:41.753 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:41 +0000 (0:00:00.077) 0:00:07.139 ***** 2021-02-13T17:00:41.757 INFO:teuthology.task.ansible.out: 2021-02-13T17:00:41.789 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba037.front.sepia.ceph.com] 2021-02-13T17:00:41.798 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2021-02-13T17:00:41.799 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:00:41.873 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:41 +0000 (0:00:00.120) 0:00:07.259 ***** 2021-02-13T17:00:41.931 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:41 +0000 (0:00:00.058) 0:00:07.318 ***** 2021-02-13T17:00:41.938 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2021-02-13T17:00:41.940 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:00:41.982 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:41 +0000 (0:00:00.050) 0:00:07.369 ***** 2021-02-13T17:00:42.105 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-02-13T17:00:42.106 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-13T17:00:42.143 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:42 +0000 (0:00:00.161) 0:00:07.530 ***** 2021-02-13T17:00:42.395 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-02-13T17:00:42.396 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.228831", "end": "2021-02-13 17:00:42.367640", "rc": 0, "start": "2021-02-13 17:00:42.138809", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} TASK [users : Create all admin users with sudo access.] ************************ ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-02-13T17:00:42.437 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:42 +0000 (0:00:00.293) 0:00:07.824 ***** 2021-02-13T17:00:42.487 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-02-13T17:00:42.564 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008685", "end": "2021-02-13 17:00:42.540912", "failed_when_result": false, "rc": 0, "start": "2021-02-13 17:00:42.532227", "stderr": "", "stderr_lines": [], "stdout": "e549618f811c1ef59d08997aa55e495f75d8d5e6", "stdout_lines": ["e549618f811c1ef59d08997aa55e495f75d8d5e6"]} 2021-02-13T17:00:42.607 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:42 +0000 (0:00:00.169) 0:00:07.993 ***** 2021-02-13T17:00:42.615 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-13T17:00:42.615 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-02-13T17:00:42.638 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:00:42.680 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:42 +0000 (0:00:00.073) 0:00:08.066 ***** 2021-02-13T17:00:42.686 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-13T17:00:42.686 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-02-13T17:00:42.719 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:00:42.755 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:42 +0000 (0:00:00.075) 0:00:08.142 ***** 2021-02-13T17:00:42.773 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-13T17:00:42.773 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-02-13T17:00:42.806 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-02-13T17:00:42.807 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:00:42.841 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:42 +0000 (0:00:00.085) 0:00:08.228 ***** 2021-02-13T17:00:42.869 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-02-13T17:00:42.870 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:00:42.909 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:42 +0000 (0:00:00.066) 0:00:08.294 ***** 2021-02-13T17:00:42.935 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:00:42.972 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:42 +0000 (0:00:00.064) 0:00:08.358 ***** 2021-02-13T17:00:42.981 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-13T17:00:42.982 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-02-13T17:00:43.061 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-02-13T17:00:43.062 INFO:teuthology.task.ansible.out: 2021-02-13T17:00:43.083 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-02-13T17:00:43.084 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-13T17:00:43.119 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:43 +0000 (0:00:00.147) 0:00:08.506 ***** 2021-02-13T17:00:43.170 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-13T17:00:43.171 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-02-13T17:00:43.249 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-02-13T17:00:43.272 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-02-13T17:00:43.347 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-02-13T17:00:43.350 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-02-13T17:00:43.423 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-02-13T17:00:43.446 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-02-13T17:00:43.531 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-02-13T17:00:43.532 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-02-13T17:00:43.629 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-02-13T17:00:43.651 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-02-13T17:00:43.715 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-02-13T17:00:43.750 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-02-13T17:00:43.815 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-02-13T17:00:43.851 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-02-13T17:00:43.910 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-02-13T17:00:43.939 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-02-13T17:00:44.004 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-02-13T17:00:44.040 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-02-13T17:00:44.094 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-02-13T17:00:44.096 INFO:teuthology.task.ansible.out: 2021-02-13T17:00:44.138 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-02-13T17:00:44.182 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-02-13T17:00:44.215 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-02-13T17:00:44.279 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-02-13T17:00:44.301 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-02-13T17:00:44.387 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-02-13T17:00:44.402 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-02-13T17:00:44.477 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-02-13T17:00:44.489 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-02-13T17:00:44.564 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-02-13T17:00:44.576 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-02-13T17:00:44.675 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-02-13T17:00:44.687 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-02-13T17:00:44.798 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-02-13T17:00:44.830 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-02-13T17:00:44.883 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-02-13T17:00:44.941 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-02-13T17:00:44.986 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-02-13T17:00:45.072 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-02-13T17:00:45.096 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-02-13T17:00:45.097 INFO:teuthology.task.ansible.out: 2021-02-13T17:00:45.194 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-02-13T17:00:45.229 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-02-13T17:00:45.318 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-02-13T17:00:45.351 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-02-13T17:00:45.438 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-02-13T17:00:45.504 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-02-13T17:00:45.547 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-02-13T17:00:45.593 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-02-13T17:00:45.679 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-02-13T17:00:45.680 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-02-13T17:00:45.681 INFO:teuthology.task.ansible.out: 2021-02-13T17:00:45.767 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-02-13T17:00:45.778 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-02-13T17:00:45.853 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-02-13T17:00:45.864 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-02-13T17:00:45.949 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-02-13T17:00:46.006 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-02-13T17:00:46.049 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-02-13T17:00:46.106 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-02-13T17:00:46.139 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-02-13T17:00:46.192 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-02-13T17:00:46.225 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-02-13T17:00:46.289 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-13T17:00:46.313 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-02-13T17:00:46.385 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-02-13T17:00:46.418 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-02-13T17:00:46.462 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-02-13T17:00:46.519 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-02-13T17:00:46.553 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-02-13T17:00:46.598 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-02-13T17:00:46.640 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-02-13T17:00:46.641 INFO:teuthology.task.ansible.out: 2021-02-13T17:00:46.684 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-02-13T17:00:46.726 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-02-13T17:00:46.769 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-02-13T17:00:46.813 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-02-13T17:00:46.866 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-02-13T17:00:46.910 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-02-13T17:00:46.954 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-13T17:00:47.010 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-13T17:00:47.076 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-02-13T17:00:47.098 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-02-13T17:00:47.164 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-02-13T17:00:47.189 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-02-13T17:00:47.254 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-02-13T17:00:47.266 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-02-13T17:00:47.341 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-02-13T17:00:47.352 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-02-13T17:00:47.427 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-02-13T17:00:47.449 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-02-13T17:00:47.513 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-02-13T17:00:47.536 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-02-13T17:00:47.538 INFO:teuthology.task.ansible.out: 2021-02-13T17:00:47.603 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-02-13T17:00:47.625 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-02-13T17:00:47.689 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-13T17:00:47.711 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-02-13T17:00:47.765 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-02-13T17:00:47.787 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-02-13T17:00:47.851 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-02-13T17:00:47.894 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-02-13T17:00:47.948 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-02-13T17:00:47.981 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-02-13T17:00:48.025 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-02-13T17:00:48.068 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-02-13T17:00:48.114 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-02-13T17:00:48.167 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-02-13T17:00:48.200 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-02-13T17:00:48.243 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-02-13T17:00:48.286 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-02-13T17:00:48.329 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-02-13T17:00:48.371 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-02-13T17:00:48.414 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-02-13T17:00:48.467 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-02-13T17:00:48.500 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-13T17:00:48.543 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-02-13T17:00:48.586 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-02-13T17:00:48.639 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-02-13T17:00:48.661 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-02-13T17:00:48.715 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-02-13T17:00:48.748 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-02-13T17:00:48.813 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-02-13T17:00:48.835 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-02-13T17:00:48.900 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-02-13T17:00:48.934 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-02-13T17:00:48.989 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-02-13T17:00:49.023 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-02-13T17:00:49.079 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-02-13T17:00:49.111 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-02-13T17:00:49.186 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-13T17:00:49.207 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-02-13T17:00:49.272 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-02-13T17:00:49.284 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-02-13T17:00:49.347 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-02-13T17:00:49.380 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-02-13T17:00:49.435 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-02-13T17:00:49.489 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-02-13T17:00:49.513 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-02-13T17:00:49.577 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-02-13T17:00:49.579 INFO:teuthology.task.ansible.out: 2021-02-13T17:00:49.612 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-02-13T17:00:49.663 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-02-13T17:00:49.696 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-02-13T17:00:49.760 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-02-13T17:00:49.782 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-02-13T17:00:49.845 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-02-13T17:00:49.870 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-02-13T17:00:49.932 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-02-13T17:00:49.966 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-02-13T17:00:50.021 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-02-13T17:00:50.053 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-02-13T17:00:50.054 INFO:teuthology.task.ansible.out: 2021-02-13T17:00:50.130 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-02-13T17:00:50.142 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-02-13T17:00:50.206 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-02-13T17:00:50.243 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-02-13T17:00:50.297 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-02-13T17:00:50.340 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-02-13T17:00:50.383 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-02-13T17:00:50.426 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-02-13T17:00:50.479 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-02-13T17:00:50.512 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-02-13T17:00:50.566 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-02-13T17:00:50.598 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-02-13T17:00:50.653 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-02-13T17:00:50.675 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-02-13T17:00:50.751 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-02-13T17:00:50.773 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-02-13T17:00:50.826 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-02-13T17:00:50.860 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-02-13T17:00:50.926 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-02-13T17:00:50.948 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-02-13T17:00:51.025 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-02-13T17:00:51.058 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-02-13T17:00:51.122 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-02-13T17:00:51.134 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-02-13T17:00:51.208 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-02-13T17:00:51.220 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-02-13T17:00:51.294 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-02-13T17:00:51.306 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-02-13T17:00:51.371 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-02-13T17:00:51.393 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-02-13T17:00:51.458 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-02-13T17:00:51.480 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-02-13T17:00:51.544 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-02-13T17:00:51.566 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-02-13T17:00:51.630 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-02-13T17:00:51.652 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-02-13T17:00:51.706 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-02-13T17:00:51.750 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-02-13T17:00:51.803 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-02-13T17:00:51.825 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-02-13T17:00:51.890 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-13T17:00:51.923 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-02-13T17:00:51.976 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-02-13T17:00:51.977 INFO:teuthology.task.ansible.out: 2021-02-13T17:00:51.999 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-02-13T17:00:52.054 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-02-13T17:00:52.086 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-02-13T17:00:52.150 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-02-13T17:00:52.182 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-02-13T17:00:52.247 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-02-13T17:00:52.261 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-02-13T17:00:52.322 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-02-13T17:00:52.355 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-02-13T17:00:52.432 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-02-13T17:00:52.455 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-02-13T17:00:52.529 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-02-13T17:00:52.561 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-13T17:00:52.616 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-02-13T17:00:52.649 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-02-13T17:00:52.714 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-02-13T17:00:52.738 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-02-13T17:00:52.813 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-02-13T17:00:52.824 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-02-13T17:00:52.901 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-02-13T17:00:52.913 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-02-13T17:00:52.999 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-02-13T17:00:53.021 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-02-13T17:00:53.117 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-02-13T17:00:53.150 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-02-13T17:00:53.214 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-02-13T17:00:53.247 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-02-13T17:00:53.311 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-02-13T17:00:53.367 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-02-13T17:00:53.400 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-02-13T17:00:53.468 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-02-13T17:00:53.488 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-02-13T17:00:53.564 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-02-13T17:00:53.587 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-02-13T17:00:53.651 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-02-13T17:00:53.673 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-02-13T17:00:53.749 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-02-13T17:00:53.760 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-02-13T17:00:53.824 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-02-13T17:00:53.849 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-02-13T17:00:53.924 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-02-13T17:00:53.946 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-02-13T17:00:54.011 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-02-13T17:00:54.054 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-02-13T17:00:54.110 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-02-13T17:00:54.143 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-02-13T17:00:54.199 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-02-13T17:00:54.221 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-02-13T17:00:54.296 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-02-13T17:00:54.330 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-02-13T17:00:54.410 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-02-13T17:00:54.455 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-02-13T17:00:54.542 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-02-13T17:00:54.553 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-02-13T17:00:54.619 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-02-13T17:00:54.653 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-02-13T17:00:54.707 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-02-13T17:00:54.751 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-02-13T17:00:54.796 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-02-13T17:00:54.842 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-02-13T17:00:54.886 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-02-13T17:00:54.929 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-02-13T17:00:54.972 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-02-13T17:00:55.015 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-02-13T17:00:55.100 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-02-13T17:00:55.185 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-02-13T17:00:55.274 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-02-13T17:00:55.275 INFO:teuthology.task.ansible.out: 2021-02-13T17:00:55.360 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-02-13T17:00:55.444 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-02-13T17:00:55.498 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "name": "pdhange", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-02-13T17:00:55.532 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-02-13T17:00:55.889 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-02-13T17:00:56.007 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "name": "pdhange", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-02-13T17:00:56.401 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "name": "adking", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-02-13T17:00:56.433 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-02-13T17:00:56.819 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "name": "amathuri", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-02-13T17:00:56.820 INFO:teuthology.task.ansible.out: 2021-02-13T17:00:56.852 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "name": "adking", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-02-13T17:00:57.235 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-02-13T17:00:57.358 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "name": "amathuri", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-02-13T17:00:57.399 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:57 +0000 (0:00:14.279) 0:00:22.786 ***** 2021-02-13T17:00:57.441 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-02-13T17:00:57.482 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:57 +0000 (0:00:00.083) 0:00:22.869 ***** 2021-02-13T17:00:57.535 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-02-13T17:00:57.537 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora r 2021-02-13T17:00:57.539 INFO:teuthology.task.ansible.out:T6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c 2021-02-13T17:00:57.540 INFO:teuthology.task.ansible.out:63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich 2021-02-13T17:00:57.542 INFO:teuthology.task.ansible.out:", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiR 2021-02-13T17:00:57.543 INFO:teuthology.task.ansible.out:enVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillam 2021-02-13T17:00:57.543 INFO:teuthology.task.ansible.out:an@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumr 2021-02-13T17:00:57.544 INFO:teuthology.task.ansible.out:ao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69m 2021-02-13T17:00:57.546 INFO:teuthology.task.ansible.out:h95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d84 2021-02-13T17:00:57.547 INFO:teuthology.task.ansible.out:1a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan 2021-02-13T17:00:57.548 INFO:teuthology.task.ansible.out:@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOen 2021-02-13T17:00:57.550 INFO:teuthology.task.ansible.out:VV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9g 2021-02-13T17:00:57.551 INFO:teuthology.task.ansible.out:I46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": " 2021-02-13T17:00:57.552 INFO:teuthology.task.ansible.out:dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "acl 2021-02-13T17:00:57.552 INFO:teuthology.task.ansible.out:ewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NIN 2021-02-13T17:00:57.554 INFO:teuthology.task.ansible.out:j0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-02-13T17:00:57.595 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:57 +0000 (0:00:00.113) 0:00:22.982 ***** 2021-02-13T17:00:57.775 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-13T17:00:57.776 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-02-13T17:00:57.911 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:57 +0000 (0:00:00.315) 0:00:23.297 ***** 2021-02-13T17:00:57.965 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-02-13T17:00:58.006 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:57 +0000 (0:00:00.094) 0:00:23.392 ***** 2021-02-13T17:00:58.066 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-02-13T17:00:58.068 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora r 2021-02-13T17:00:58.069 INFO:teuthology.task.ansible.out:T6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c 2021-02-13T17:00:58.071 INFO:teuthology.task.ansible.out:63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich 2021-02-13T17:00:58.073 INFO:teuthology.task.ansible.out:", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiR 2021-02-13T17:00:58.074 INFO:teuthology.task.ansible.out:enVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdi 2021-02-13T17:00:58.075 INFO:teuthology.task.ansible.out:llaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumr 2021-02-13T17:00:58.076 INFO:teuthology.task.ansible.out:ao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69m 2021-02-13T17:00:58.077 INFO:teuthology.task.ansible.out:h95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d84 2021-02-13T17:00:58.079 INFO:teuthology.task.ansible.out:1a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan 2021-02-13T17:00:58.080 INFO:teuthology.task.ansible.out:@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOen 2021-02-13T17:00:58.081 INFO:teuthology.task.ansible.out:VV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9g 2021-02-13T17:00:58.083 INFO:teuthology.task.ansible.out:I46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": " 2021-02-13T17:00:58.084 INFO:teuthology.task.ansible.out:dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "acl 2021-02-13T17:00:58.084 INFO:teuthology.task.ansible.out:ewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NIN 2021-02-13T17:00:58.086 INFO:teuthology.task.ansible.out:j0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-02-13T17:00:58.135 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:58 +0000 (0:00:00.129) 0:00:23.522 ***** 2021-02-13T17:00:58.515 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-02-13T17:00:58.516 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com -> localhost] => {"after": "df8946f08e870e2d2565b79099289ca48bd825f3", "attempts": 1, "before": "df8946f08e870e2d2565b79099289ca48bd825f3", "changed": false, "remote_url_changed": false} 2021-02-13T17:00:58.561 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:58 +0000 (0:00:00.425) 0:00:23.948 ***** 2021-02-13T17:00:58.749 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-13T17:00:58.750 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-02-13T17:00:58.803 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-02-13T17:00:58.804 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com -> localhost] => {"after": "df8946f08e870e2d2565b79099289ca48bd825f3", "attempts": 1, "before": "df8946f08e870e2d2565b79099289ca48bd825f3", "changed": false, "remote_url_changed": false} 2021-02-13T17:00:58.841 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:00:58 +0000 (0:00:00.279) 0:00:24.227 ***** 2021-02-13T17:00:58.916 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-02-13T17:00:59.012 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-02-13T17:00:59.026 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-02-13T17:00:59.109 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-02-13T17:00:59.143 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-02-13T17:00:59.144 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-02-13T17:00:59.240 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-02-13T17:00:59.253 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-02-13T17:00:59.371 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-02-13T17:00:59.372 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3Nz 2021-02-13T17:00:59.373 INFO:teuthology.task.ansible.out:aC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-02-13T17:00:59.488 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-02-13T17:00:59.510 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-02-13T17:00:59.657 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-02-13T17:00:59.659 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-02-13T17:00:59.665 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-02-13T17:00:59.776 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-02-13T17:00:59.810 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-02-13T17:00:59.823 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:00:59.921 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-02-13T17:00:59.932 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-02-13T17:00:59.933 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-02-13T17:01:00.028 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-02-13T17:01:00.029 INFO:teuthology.task.ansible.out:on", "validate_certs": true} 2021-02-13T17:01:00.062 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:00.071 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-02-13T17:01:00.083 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:00.084 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:00.169 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-02-13T17:01:00.214 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-02-13T17:01:00.215 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-02-13T17:01:00.299 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-02-13T17:01:00.301 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-02-13T17:01:00.376 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-02-13T17:01:00.377 INFO:teuthology.task.ansible.out:on", "validate_certs": true} 2021-02-13T17:01:00.389 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:00.390 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-02-13T17:01:00.402 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:00.507 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2021-02-13T17:01:00.530 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-02-13T17:01:00.596 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-02-13T17:01:00.638 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-02-13T17:01:00.640 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-02-13T17:01:00.692 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-02-13T17:01:00.747 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-02-13T17:01:00.790 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-02-13T17:01:00.790 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:00.855 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2021-02-13T17:01:00.909 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-02-13T17:01:00.910 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-02-13T17:01:00.963 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-02-13T17:01:01.022 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-02-13T17:01:01.023 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-02-13T17:01:01.075 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-02-13T17:01:01.118 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-02-13T17:01:01.161 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-02-13T17:01:01.225 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-02-13T17:01:01.268 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-02-13T17:01:01.269 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-02-13T17:01:01.322 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46T 2021-02-13T17:01:01.324 INFO:teuthology.task.ansible.out:RJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-02-13T17:01:01.365 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-02-13T17:01:01.366 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-02-13T17:01:01.429 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-02-13T17:01:01.461 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-02-13T17:01:01.462 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:01.526 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-02-13T17:01:01.559 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-02-13T17:01:01.635 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-02-13T17:01:01.678 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46T 2021-02-13T17:01:01.679 INFO:teuthology.task.ansible.out:RJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-02-13T17:01:01.753 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-02-13T17:01:01.798 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-02-13T17:01:01.862 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-02-13T17:01:01.894 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-02-13T17:01:01.961 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-02-13T17:01:01.963 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-02-13T17:01:01.983 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-02-13T17:01:02.089 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-02-13T17:01:02.090 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-02-13T17:01:02.186 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-02-13T17:01:02.208 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-02-13T17:01:02.295 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-02-13T17:01:02.297 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-02-13T17:01:02.359 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-02-13T17:01:02.413 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-02-13T17:01:02.458 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-02-13T17:01:02.533 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-02-13T17:01:02.576 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-02-13T17:01:02.651 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-02-13T17:01:02.685 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-02-13T17:01:02.760 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-02-13T17:01:02.782 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-13T17:01:02.887 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-02-13T17:01:02.909 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-02-13T17:01:03.026 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-02-13T17:01:03.037 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-02-13T17:01:03.123 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-02-13T17:01:03.124 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-02-13T17:01:03.166 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-13T17:01:03.253 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-02-13T17:01:03.255 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-02-13T17:01:03.278 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-02-13T17:01:03.371 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-02-13T17:01:03.434 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-02-13T17:01:03.527 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-02-13T17:01:03.529 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-02-13T17:01:03.550 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-02-13T17:01:03.666 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-02-13T17:01:03.668 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-02-13T17:01:03.690 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-02-13T17:01:03.819 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nul 2021-02-13T17:01:03.826 INFO:teuthology.task.ansible.out:l, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-13T17:01:03.858 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-02-13T17:01:03.859 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:03.957 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-02-13T17:01:03.959 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-02-13T17:01:03.960 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-02-13T17:01:03.979 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-02-13T17:01:04.076 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-02-13T17:01:04.115 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-02-13T17:01:04.245 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-02-13T17:01:04.281 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nul 2021-02-13T17:01:04.283 INFO:teuthology.task.ansible.out:l, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-13T17:01:04.376 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-02-13T17:01:04.398 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-02-13T17:01:04.401 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-02-13T17:01:04.404 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-02-13T17:01:04.505 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-02-13T17:01:04.516 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-02-13T17:01:04.622 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-02-13T17:01:04.655 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-02-13T17:01:04.771 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-02-13T17:01:04.804 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-02-13T17:01:04.806 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-02-13T17:01:04.944 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-02-13T17:01:04.945 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-02-13T17:01:05.066 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_c 2021-02-13T17:01:05.068 INFO:teuthology.task.ansible.out:erts": true} 2021-02-13T17:01:05.171 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-02-13T17:01:05.173 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-02-13T17:01:05.197 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-02-13T17:01:05.198 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-02-13T17:01:05.313 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-02-13T17:01:05.348 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-02-13T17:01:05.465 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-02-13T17:01:05.498 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-02-13T17:01:05.578 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-02-13T17:01:05.580 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-02-13T17:01:05.631 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-02-13T17:01:05.633 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-02-13T17:01:05.685 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-02-13T17:01:05.729 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-02-13T17:01:05.788 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-02-13T17:01:05.821 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-02-13T17:01:05.896 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-02-13T17:01:05.897 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-02-13T17:01:05.928 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-02-13T17:01:06.016 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-02-13T17:01:06.039 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-13T17:01:06.149 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-02-13T17:01:06.171 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-02-13T17:01:06.259 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-02-13T17:01:06.271 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-02-13T17:01:06.368 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-02-13T17:01:06.369 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-13T17:01:06.455 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-02-13T17:01:06.467 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-02-13T17:01:06.553 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-02-13T17:01:06.575 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-02-13T17:01:06.672 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-02-13T17:01:06.683 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-02-13T17:01:06.783 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-02-13T17:01:06.811 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-02-13T17:01:06.867 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-02-13T17:01:06.910 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-02-13T17:01:06.987 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-02-13T17:01:07.020 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-02-13T17:01:07.096 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-02-13T17:01:07.108 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-02-13T17:01:07.193 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-02-13T17:01:07.215 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-02-13T17:01:07.290 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-02-13T17:01:07.325 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-02-13T17:01:07.431 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-02-13T17:01:07.433 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-02-13T17:01:07.550 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-02-13T17:01:07.583 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-02-13T17:01:07.689 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-02-13T17:01:07.722 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-02-13T17:01:07.797 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-02-13T17:01:07.852 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-02-13T17:01:07.886 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-02-13T17:01:07.958 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-02-13T17:01:07.960 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-02-13T17:01:08.009 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-02-13T17:01:08.064 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-02-13T17:01:08.118 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-02-13T17:01:08.118 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:08.193 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-02-13T17:01:08.225 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-02-13T17:01:08.226 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-02-13T17:01:08.329 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-02-13T17:01:08.351 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-02-13T17:01:08.435 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-02-13T17:01:08.447 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-02-13T17:01:08.552 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-02-13T17:01:08.564 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdo 2021-02-13T17:01:08.565 INFO:teuthology.task.ansible.out:main", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-02-13T17:01:08.684 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-02-13T17:01:08.686 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-02-13T17:01:08.696 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-02-13T17:01:08.802 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-02-13T17:01:08.845 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdo 2021-02-13T17:01:08.846 INFO:teuthology.task.ansible.out:main", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-02-13T17:01:08.910 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-02-13T17:01:09.006 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-02-13T17:01:09.007 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-02-13T17:01:09.028 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-02-13T17:01:09.113 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-02-13T17:01:09.136 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-02-13T17:01:09.231 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-02-13T17:01:09.253 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-02-13T17:01:09.339 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-02-13T17:01:09.364 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-02-13T17:01:09.477 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-02-13T17:01:09.520 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-02-13T17:01:09.598 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-02-13T17:01:09.599 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-02-13T17:01:09.716 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": fa 2021-02-13T17:01:09.717 INFO:teuthology.task.ansible.out:lse, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-02-13T17:01:09.822 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-02-13T17:01:09.846 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-02-13T17:01:09.937 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-02-13T17:01:09.949 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-02-13T17:01:10.081 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-02-13T17:01:10.082 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-02-13T17:01:10.194 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-02-13T17:01:10.206 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-02-13T17:01:10.284 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-02-13T17:01:10.328 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-02-13T17:01:10.396 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-02-13T17:01:10.438 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", " 2021-02-13T17:01:10.440 INFO:teuthology.task.ansible.out:manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-13T17:01:10.482 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-02-13T17:01:10.540 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-02-13T17:01:10.584 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-02-13T17:01:10.637 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-02-13T17:01:10.701 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-02-13T17:01:10.734 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-02-13T17:01:10.799 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", " 2021-02-13T17:01:10.800 INFO:teuthology.task.ansible.out:manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-13T17:01:10.851 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-02-13T17:01:10.918 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-02-13T17:01:10.995 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-02-13T17:01:11.048 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-02-13T17:01:11.112 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-02-13T17:01:11.165 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-02-13T17:01:11.242 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-02-13T17:01:11.283 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-02-13T17:01:11.357 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-02-13T17:01:11.379 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-02-13T17:01:11.474 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-02-13T17:01:11.510 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-02-13T17:01:11.594 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-02-13T17:01:11.616 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-02-13T17:01:11.724 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-02-13T17:01:11.767 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-02-13T17:01:11.851 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-02-13T17:01:11.863 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-02-13T17:01:11.960 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-02-13T17:01:12.013 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-02-13T17:01:12.015 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:12.069 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-02-13T17:01:12.091 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-02-13T17:01:12.175 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-02-13T17:01:12.208 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-02-13T17:01:12.283 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-02-13T17:01:12.339 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-02-13T17:01:12.434 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-02-13T17:01:12.435 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-02-13T17:01:12.535 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-02-13T17:01:12.569 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-02-13T17:01:12.657 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-02-13T17:01:12.659 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-02-13T17:01:12.668 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-02-13T17:01:12.742 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-02-13T17:01:12.778 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-02-13T17:01:12.844 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-02-13T17:01:12.887 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-02-13T17:01:12.932 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-02-13T17:01:12.992 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-02-13T17:01:12.993 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-02-13T17:01:13.045 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-02-13T17:01:13.080 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-02-13T17:01:13.155 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-02-13T17:01:13.177 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-02-13T17:01:13.264 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-02-13T17:01:13.290 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-02-13T17:01:13.360 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-02-13T17:01:13.362 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:13.403 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-02-13T17:01:13.468 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-02-13T17:01:13.500 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-02-13T17:01:13.564 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-02-13T17:01:13.628 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-02-13T17:01:13.685 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-02-13T17:01:13.738 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-02-13T17:01:13.791 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-02-13T17:01:13.834 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-02-13T17:01:13.910 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-02-13T17:01:13.933 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-02-13T17:01:14.012 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-02-13T17:01:14.035 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-02-13T17:01:14.146 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-02-13T17:01:14.168 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-02-13T17:01:14.242 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-02-13T17:01:14.299 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-02-13T17:01:14.354 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-02-13T17:01:14.397 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-02-13T17:01:14.454 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com", "key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-02-13T17:01:14.500 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-02-13T17:01:14.553 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-02-13T17:01:14.666 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:14 +0000 (0:00:15.824) 0:00:40.052 ***** 2021-02-13T17:01:14.676 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-02-13T17:01:14.733 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-02-13T17:01:14.745 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-13T17:01:14.747 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:14.757 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:14.770 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:14.791 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:14.802 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:14.814 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:14.825 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:14.839 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:14.848 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:14.861 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [gibba037.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com", "key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-02-13T17:01:14.965 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-13T17:01:14.966 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} TASK [users : Update authorized_keys using the keys repo] ********************** changed: [gibba037.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': ' 2021-02-13T17:01:14.968 INFO:teuthology.task.ansible.out:nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-02-13T17:01:15.032 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-13T17:01:15.033 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.034 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.078 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:15 +0000 (0:00:00.410) 0:00:40.463 ***** 2021-02-13T17:01:15.097 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-02-13T17:01:15.132 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.133 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.145 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.167 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.179 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.190 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-02-13T17:01:15.213 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.224 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.251 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.253 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.263 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.263 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.274 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.275 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.286 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.297 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.297 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.309 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.331 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.343 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.354 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.355 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.376 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.377 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.387 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.398 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.399 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-02-13T17:01:15.411 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.416 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc 2021-02-13T17:01:15.418 INFO:teuthology.task.ansible.out:8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.447 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.448 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:15.458 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.469 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.485 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.503 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.514 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.525 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-02-13T17:01:15.536 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.536 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.538 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.548 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.559 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.572 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.581 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.583 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.604 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.605 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.617 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-02-13T17:01:15.629 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.630 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.641 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.642 INFO:teuthology.task.ansible.out: skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.665 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.676 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.687 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.699 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.722 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.733 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.745 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.746 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.758 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.759 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.760 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.772 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.775 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.787 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.798 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.799 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.810 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.812 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.823 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.824 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:15.834 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.836 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:15.846 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.859 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.868 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.872 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.873 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.896 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.907 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.918 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.930 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.931 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.942 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.950 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.956 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.967 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.968 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.969 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.971 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.981 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:15.992 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.003 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.004 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.015 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.017 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.028 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.039 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.041 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.051 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.051 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.052 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.063 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.064 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.074 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.075 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.086 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.092 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.097 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.099 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:16.109 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.111 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.121 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.125 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.125 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.136 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.137 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.148 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.159 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.161 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.171 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.172 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.183 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.184 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:16.195 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.196 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.197 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.199 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.209 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.210 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:16.211 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.222 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.223 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.224 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.235 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.236 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.246 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.247 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.248 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.259 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.260 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.271 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.271 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.282 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.283 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.284 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.295 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.296 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.307 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.308 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.320 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.328 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.331 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.332 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.344 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.346 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.358 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.360 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.360 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.375 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.375 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.378 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.379 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.380 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.391 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.392 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.403 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.404 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.405 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.415 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.418 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.428 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.441 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.455 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.466 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.467 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.469 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.480 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.480 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.482 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.492 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.504 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.504 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.507 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.518 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.519 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.520 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.532 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.533 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.546 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.556 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.568 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.579 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.594 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.597 INFO:teuthology.task.ansible.out: skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.608 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.620 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.631 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.631 INFO:teuthology.task.ansible.out: skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.633 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:16.644 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.646 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:16.655 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.658 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.667 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.668 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.680 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.680 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.691 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.692 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.703 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.707 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.718 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.719 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.747 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.748 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.749 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.787 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:16 +0000 (0:00:01.711) 0:00:42.174 ***** 2021-02-13T17:01:16.794 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.795 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.796 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.809 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.810 INFO:teuthology.task.ansible.out: skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.811 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:16.822 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.859 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:16 +0000 (0:00:00.072) 0:00:42.246 ***** 2021-02-13T17:01:16.868 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.868 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.870 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.881 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.883 INFO:teuthology.task.ansible.out: skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.885 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.895 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.906 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.919 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.929 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.930 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.951 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.953 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.963 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.964 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:16.965 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.976 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:16.976 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:17.040 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:17 +0000 (0:00:00.180) 0:00:42.426 ***** 2021-02-13T17:01:17.052 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-13T17:01:17.054 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-02-13T17:01:17.086 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2021-02-13T17:01:17.088 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:17.129 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:17 +0000 (0:00:00.089) 0:00:42.516 ***** 2021-02-13T17:01:17.138 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-13T17:01:17.139 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-02-13T17:01:17.195 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-02-13T17:01:17.270 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-02-13T17:01:17.281 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-02-13T17:01:17.366 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-02-13T17:01:17.378 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-02-13T17:01:17.461 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-02-13T17:01:17.483 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-02-13T17:01:17.592 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-02-13T17:01:17.601 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-02-13T17:01:17.696 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-02-13T17:01:17.709 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-02-13T17:01:17.791 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-02-13T17:01:17.813 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-02-13T17:01:17.927 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-02-13T17:01:17.960 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-02-13T17:01:17.961 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:18.024 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-02-13T17:01:18.057 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-02-13T17:01:18.133 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-02-13T17:01:18.197 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-02-13T17:01:18.230 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-02-13T17:01:18.314 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-02-13T17:01:18.314 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-02-13T17:01:18.412 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-02-13T17:01:18.423 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-02-13T17:01:18.514 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-02-13T17:01:18.526 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-02-13T17:01:18.526 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:18.594 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-02-13T17:01:18.626 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-02-13T17:01:18.679 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-02-13T17:01:18.733 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-02-13T17:01:18.832 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-02-13T17:01:18.842 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-02-13T17:01:18.928 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-02-13T17:01:18.940 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-02-13T17:01:19.038 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-02-13T17:01:19.060 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-02-13T17:01:19.134 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-02-13T17:01:19.156 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-02-13T17:01:19.242 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-02-13T17:01:19.243 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-02-13T17:01:19.247 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:19.347 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-02-13T17:01:19.391 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-02-13T17:01:19.434 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-02-13T17:01:19.509 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-02-13T17:01:19.520 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-02-13T17:01:19.606 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-02-13T17:01:19.618 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-02-13T17:01:19.693 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-02-13T17:01:19.704 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-02-13T17:01:19.793 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-02-13T17:01:19.793 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-02-13T17:01:19.882 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-02-13T17:01:19.883 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-02-13T17:01:19.957 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-02-13T17:01:20.021 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-02-13T17:01:20.088 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-02-13T17:01:20.120 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-02-13T17:01:20.163 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-02-13T17:01:20.195 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-02-13T17:01:20.298 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-02-13T17:01:20.307 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-02-13T17:01:20.394 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-02-13T17:01:20.406 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-02-13T17:01:20.485 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-02-13T17:01:20.539 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-02-13T17:01:20.583 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-02-13T17:01:20.625 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-02-13T17:01:20.681 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-02-13T17:01:20.714 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-02-13T17:01:20.779 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-02-13T17:01:20.873 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-02-13T17:01:21.012 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-02-13T17:01:21.128 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-02-13T17:01:21.152 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "zyan", "name": "zyan", "remove": false, "state": "absent"} 2021-02-13T17:01:21.207 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-02-13T17:01:21.271 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-02-13T17:01:21.366 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-02-13T17:01:21.463 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-02-13T17:01:21.547 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-02-13T17:01:21.568 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "zyan", "name": "zyan", "remove": false, "state": "absent"} 2021-02-13T17:01:21.674 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-02-13T17:01:21.675 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-02-13T17:01:21.759 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-02-13T17:01:21.760 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-02-13T17:01:21.845 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-02-13T17:01:21.856 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-02-13T17:01:21.941 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-02-13T17:01:21.953 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-02-13T17:01:22.039 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-02-13T17:01:22.040 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-02-13T17:01:22.124 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-02-13T17:01:22.136 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-02-13T17:01:22.199 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:22 +0000 (0:00:05.069) 0:00:47.585 ***** 2021-02-13T17:01:22.263 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-02-13T17:01:22.348 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-02-13T17:01:22.443 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-02-13T17:01:22.527 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-02-13T17:01:22.529 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "checksum": "5ebc9fcf8859a9c716ab10089a7bec7e44d29368", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "ee06ed012f51c2e3764171d4b9180349", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613235682.2225876-276232229948822/source", "state": "file", "uid": 0} 2021-02-13T17:01:22.567 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:22 +0000 (0:00:00.368) 0:00:47.954 ***** 2021-02-13T17:01:22.578 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-13T17:01:22.578 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-02-13T17:01:22.639 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:22 +0000 (0:00:00.071) 0:00:48.026 ***** 2021-02-13T17:01:22.648 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-02-13T17:01:22.649 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => { "msg": "Host gibba038.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2021-02-13T17:01:22.701 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:22 +0000 (0:00:00.061) 0:00:48.088 ***** 2021-02-13T17:01:22.771 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-02-13T17:01:22.773 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-02-13T17:01:22.814 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:22 +0000 (0:00:00.113) 0:00:48.201 ***** 2021-02-13T17:01:22.853 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-02-13T17:01:22.854 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:22.894 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:22 +0000 (0:00:00.079) 0:00:48.281 ***** 2021-02-13T17:01:22.922 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:22.969 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:22 +0000 (0:00:00.074) 0:00:48.355 ***** 2021-02-13T17:01:22.980 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-02-13T17:01:22.982 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "checksum": "5ebc9fcf8859a9c716ab10089a7bec7e44d29368", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "ee06ed012f51c2e3764171d4b9180349", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613235682.6660562-265270429701022/source", "state": "file", "uid": 0} 2021-02-13T17:01:23.022 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:23 +0000 (0:00:00.053) 0:00:48.409 ***** 2021-02-13T17:01:23.030 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-02-13T17:01:23.032 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:23.076 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:23 +0000 (0:00:00.053) 0:00:48.463 ***** 2021-02-13T17:01:23.085 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [gibba037.front.sepia.ceph.com] => { "msg": "Host gibba037.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2021-02-13T17:01:23.128 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:23 +0000 (0:00:00.051) 0:00:48.514 ***** 2021-02-13T17:01:23.135 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-02-13T17:01:23.137 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:23.180 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:23 +0000 (0:00:00.052) 0:00:48.567 ***** 2021-02-13T17:01:23.199 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-02-13T17:01:23.201 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-02-13T17:01:23.241 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:23 +0000 (0:00:00.060) 0:00:48.627 ***** 2021-02-13T17:01:23.247 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-02-13T17:01:23.249 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:23.294 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:23 +0000 (0:00:00.053) 0:00:48.681 ***** 2021-02-13T17:01:23.313 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-02-13T17:01:23.315 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:23.355 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:23 +0000 (0:00:00.060) 0:00:48.741 ***** 2021-02-13T17:01:23.364 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-02-13T17:01:23.364 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:23.409 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:23 +0000 (0:00:00.053) 0:00:48.795 ***** 2021-02-13T17:01:23.416 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-02-13T17:01:23.417 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:23.463 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:23 +0000 (0:00:00.054) 0:00:48.850 ***** 2021-02-13T17:01:23.477 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-02-13T17:01:23.478 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:23.522 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:23 +0000 (0:00:00.057) 0:00:48.908 ***** 2021-02-13T17:01:23.528 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-02-13T17:01:23.529 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:23.567 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:23 +0000 (0:00:00.045) 0:00:48.953 ***** 2021-02-13T17:01:23.573 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-02-13T17:01:23.574 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:23.614 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:23 +0000 (0:00:00.047) 0:00:49.001 ***** 2021-02-13T17:01:23.620 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-02-13T17:01:23.622 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:23.665 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:23 +0000 (0:00:00.051) 0:00:49.052 ***** 2021-02-13T17:01:23.675 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-02-13T17:01:23.676 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:01:23.717 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:23 +0000 (0:00:00.051) 0:00:49.104 ***** 2021-02-13T17:01:23.731 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:23.779 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:23 +0000 (0:00:00.061) 0:00:49.165 ***** 2021-02-13T17:01:23.786 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-02-13T17:01:23.790 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:23.839 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:23 +0000 (0:00:00.060) 0:00:49.226 ***** 2021-02-13T17:01:23.852 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-02-13T17:01:23.853 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:23.892 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:23 +0000 (0:00:00.052) 0:00:49.279 ***** 2021-02-13T17:01:23.899 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-02-13T17:01:23.900 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:23.937 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:23 +0000 (0:00:00.044) 0:00:49.324 ***** 2021-02-13T17:01:23.943 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-02-13T17:01:23.945 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:23.983 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:23 +0000 (0:00:00.046) 0:00:49.370 ***** 2021-02-13T17:01:23.990 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-02-13T17:01:23.991 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:01:24.030 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:24 +0000 (0:00:00.046) 0:00:49.416 ***** 2021-02-13T17:01:24.038 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:24.082 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:24 +0000 (0:00:00.052) 0:00:49.469 ***** 2021-02-13T17:01:24.088 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-02-13T17:01:24.090 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:24.132 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:24 +0000 (0:00:00.049) 0:00:49.518 ***** 2021-02-13T17:01:24.138 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-02-13T17:01:24.139 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:01:24.140 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:01:24.194 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:24 +0000 (0:00:00.059) 0:00:49.578 ***** 2021-02-13T17:01:24.204 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-02-13T17:01:24.205 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:01:24.247 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:24 +0000 (0:00:00.055) 0:00:49.634 ***** 2021-02-13T17:01:24.254 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-02-13T17:01:24.255 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:24.296 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:24 +0000 (0:00:00.048) 0:00:49.683 ***** 2021-02-13T17:01:24.304 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-02-13T17:01:24.306 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:24.346 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:24 +0000 (0:00:00.050) 0:00:49.733 ***** 2021-02-13T17:01:24.352 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-02-13T17:01:24.354 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:24.395 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:24 +0000 (0:00:00.048) 0:00:49.781 ***** 2021-02-13T17:01:24.401 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-02-13T17:01:24.403 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:24.448 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:24 +0000 (0:00:00.053) 0:00:49.835 ***** 2021-02-13T17:01:24.472 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-02-13T17:01:24.474 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:01:24.508 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:24 +0000 (0:00:00.060) 0:00:49.895 ***** 2021-02-13T17:01:24.516 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-02-13T17:01:24.518 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:24.556 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:24 +0000 (0:00:00.047) 0:00:49.943 ***** 2021-02-13T17:01:24.564 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-02-13T17:01:24.566 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:24.603 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:24 +0000 (0:00:00.046) 0:00:49.990 ***** 2021-02-13T17:01:24.611 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-02-13T17:01:24.613 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:24.654 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:24 +0000 (0:00:00.051) 0:00:50.041 ***** 2021-02-13T17:01:24.661 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-02-13T17:01:24.662 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:01:24.700 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:24 +0000 (0:00:00.046) 0:00:50.087 ***** 2021-02-13T17:01:24.707 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-02-13T17:01:24.708 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:01:24.746 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:24 +0000 (0:00:00.045) 0:00:50.133 ***** 2021-02-13T17:01:24.752 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-02-13T17:01:24.754 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:24.799 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:24 +0000 (0:00:00.052) 0:00:50.186 ***** 2021-02-13T17:01:24.806 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-02-13T17:01:24.806 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:24.848 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:24 +0000 (0:00:00.049) 0:00:50.235 ***** 2021-02-13T17:01:24.856 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-02-13T17:01:24.859 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:24.902 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:24 +0000 (0:00:00.053) 0:00:50.288 ***** 2021-02-13T17:01:24.909 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-02-13T17:01:24.911 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:24.950 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:24 +0000 (0:00:00.048) 0:00:50.337 ***** 2021-02-13T17:01:24.956 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-02-13T17:01:24.958 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:24.994 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:24 +0000 (0:00:00.044) 0:00:50.381 ***** 2021-02-13T17:01:25.001 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-02-13T17:01:25.002 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:25.043 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:25 +0000 (0:00:00.049) 0:00:50.430 ***** 2021-02-13T17:01:25.050 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-02-13T17:01:25.052 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:25.096 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:25 +0000 (0:00:00.052) 0:00:50.483 ***** 2021-02-13T17:01:25.104 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-02-13T17:01:25.106 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:25.150 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:25 +0000 (0:00:00.054) 0:00:50.537 ***** 2021-02-13T17:01:25.157 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-02-13T17:01:25.158 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:01:25.196 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:25 +0000 (0:00:00.045) 0:00:50.582 ***** 2021-02-13T17:01:25.204 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-02-13T17:01:25.205 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:25.244 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:25 +0000 (0:00:00.045) 0:00:50.628 ***** 2021-02-13T17:01:25.251 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-02-13T17:01:25.252 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:25.290 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:25 +0000 (0:00:00.048) 0:00:50.677 ***** 2021-02-13T17:01:25.296 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-02-13T17:01:25.298 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:25.338 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:25 +0000 (0:00:00.048) 0:00:50.725 ***** 2021-02-13T17:01:25.345 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-02-13T17:01:25.346 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:25.384 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:25 +0000 (0:00:00.045) 0:00:50.771 ***** 2021-02-13T17:01:25.391 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-02-13T17:01:25.392 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:01:25.430 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:25 +0000 (0:00:00.046) 0:00:50.817 ***** 2021-02-13T17:01:25.437 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-02-13T17:01:25.439 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:25.478 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:25 +0000 (0:00:00.047) 0:00:50.865 ***** 2021-02-13T17:01:25.487 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:25.529 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:25 +0000 (0:00:00.051) 0:00:50.916 ***** 2021-02-13T17:01:25.535 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-02-13T17:01:25.535 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:25.575 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:25 +0000 (0:00:00.046) 0:00:50.962 ***** 2021-02-13T17:01:25.587 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:25.624 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:25 +0000 (0:00:00.048) 0:00:51.010 ***** 2021-02-13T17:01:25.630 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-02-13T17:01:25.632 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:25.669 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:25 +0000 (0:00:00.044) 0:00:51.055 ***** 2021-02-13T17:01:25.677 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-02-13T17:01:25.678 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:25.718 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:25 +0000 (0:00:00.049) 0:00:51.105 ***** 2021-02-13T17:01:25.724 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-02-13T17:01:25.725 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:25.764 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:25 +0000 (0:00:00.046) 0:00:51.151 ***** 2021-02-13T17:01:25.772 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-02-13T17:01:25.772 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:25.773 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:25.819 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:25 +0000 (0:00:00.054) 0:00:51.206 ***** 2021-02-13T17:01:25.836 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-02-13T17:01:25.837 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:01:25.877 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:25 +0000 (0:00:00.058) 0:00:51.264 ***** 2021-02-13T17:01:25.887 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-02-13T17:01:25.888 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-02-13T17:01:25.927 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:25 +0000 (0:00:00.050) 0:00:51.314 ***** 2021-02-13T17:01:25.937 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-02-13T17:01:25.938 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:25.976 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:25 +0000 (0:00:00.048) 0:00:51.363 ***** 2021-02-13T17:01:25.983 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-02-13T17:01:25.985 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.033 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:26 +0000 (0:00:00.056) 0:00:51.419 ***** 2021-02-13T17:01:26.034 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:26.040 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:26.041 INFO:teuthology.task.ansible.out:TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-02-13T17:01:26.043 INFO:teuthology.task.ansible.out: skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.080 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:26 +0000 (0:00:00.047) 0:00:51.467 ***** 2021-02-13T17:01:26.108 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-02-13T17:01:26.109 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.149 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:26 +0000 (0:00:00.068) 0:00:51.535 ***** 2021-02-13T17:01:26.168 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-02-13T17:01:26.169 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.010841", "end": "2021-02-13 17:01:25.991998", "rc": 0, "start": "2021-02-13 17:01:25.981157", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-02-13T17:01:26.206 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:26 +0000 (0:00:00.057) 0:00:51.593 ***** 2021-02-13T17:01:26.219 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-02-13T17:01:26.221 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.259 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:26 +0000 (0:00:00.052) 0:00:51.646 ***** 2021-02-13T17:01:26.266 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-02-13T17:01:26.267 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.309 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:26 +0000 (0:00:00.050) 0:00:51.696 ***** 2021-02-13T17:01:26.317 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-02-13T17:01:26.318 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.319 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.356 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:26 +0000 (0:00:00.046) 0:00:51.742 ***** 2021-02-13T17:01:26.363 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-02-13T17:01:26.364 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.404 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:26 +0000 (0:00:00.048) 0:00:51.791 ***** 2021-02-13T17:01:26.416 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.460 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:26 +0000 (0:00:00.056) 0:00:51.847 ***** 2021-02-13T17:01:26.477 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-02-13T17:01:26.478 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.499 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.501 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.511 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.556 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:26 +0000 (0:00:00.095) 0:00:51.943 ***** 2021-02-13T17:01:26.583 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.584 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-02-13T17:01:26.584 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.008265", "end": "2021-02-13 17:01:26.564070", "rc": 0, "start": "2021-02-13 17:01:26.555805", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-02-13T17:01:26.626 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:26 +0000 (0:00:00.070) 0:00:52.013 ***** 2021-02-13T17:01:26.667 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:26 +0000 (0:00:00.040) 0:00:52.053 ***** 2021-02-13T17:01:26.675 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.717 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:26 +0000 (0:00:00.050) 0:00:52.104 ***** 2021-02-13T17:01:26.726 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-02-13T17:01:26.728 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.771 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:26 +0000 (0:00:00.054) 0:00:52.158 ***** 2021-02-13T17:01:26.779 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-02-13T17:01:26.779 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.822 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:26 +0000 (0:00:00.050) 0:00:52.209 ***** 2021-02-13T17:01:26.829 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-02-13T17:01:26.830 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.883 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:26 +0000 (0:00:00.060) 0:00:52.270 ***** 2021-02-13T17:01:26.890 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-02-13T17:01:26.891 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.892 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.939 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:26 +0000 (0:00:00.056) 0:00:52.326 ***** 2021-02-13T17:01:26.947 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-02-13T17:01:26.949 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:26.987 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:26 +0000 (0:00:00.047) 0:00:52.374 ***** 2021-02-13T17:01:26.998 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-02-13T17:01:26.999 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:27.040 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:27 +0000 (0:00:00.053) 0:00:52.427 ***** 2021-02-13T17:01:27.048 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-02-13T17:01:27.049 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:27.092 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:27 +0000 (0:00:00.051) 0:00:52.478 ***** 2021-02-13T17:01:27.100 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-02-13T17:01:27.101 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:27.151 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:27 +0000 (0:00:00.059) 0:00:52.538 ***** 2021-02-13T17:01:27.191 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-02-13T17:01:27.192 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:27.233 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:27 +0000 (0:00:00.081) 0:00:52.620 ***** 2021-02-13T17:01:27.261 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-02-13T17:01:27.263 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:27.301 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:27 +0000 (0:00:00.067) 0:00:52.687 ***** 2021-02-13T17:01:27.330 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-02-13T17:01:27.332 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:27.367 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:27 +0000 (0:00:00.066) 0:00:52.753 ***** 2021-02-13T17:01:27.523 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-02-13T17:01:27.525 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.068809", "end": "2021-02-13 17:01:27.507622", "rc": 0, "start": "2021-02-13 17:01:27.438813", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:01:27.584 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:27 +0000 (0:00:00.217) 0:00:52.971 ***** 2021-02-13T17:01:27.613 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-02-13T17:01:27.614 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:27.650 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:27 +0000 (0:00:00.066) 0:00:53.037 ***** 2021-02-13T17:01:27.812 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ [WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.042307", "end": "2021-02-13 17:01:27.786213", "rc": 0, "start": "2021-02-13 17:01:27.743906", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:01:27.848 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:27 +0000 (0:00:00.197) 0:00:53.235 ***** 2021-02-13T17:01:28.746 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-02-13T17:01:28.749 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.533668", "end": "2021-02-13 17:01:28.572869", "rc": 0, "start": "2021-02-13 17:01:27.039201", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:01:28.787 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:28 +0000 (0:00:00.938) 0:00:54.173 ***** 2021-02-13T17:01:28.815 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-02-13T17:01:28.816 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:28.851 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:28 +0000 (0:00:00.064) 0:00:54.238 ***** 2021-02-13T17:01:29.029 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.049501", "end": "2021-02-13 17:01:28.841820", "rc": 0, "start": "2021-02-13 17:01:28.792319", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:01:29.067 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:29 +0000 (0:00:00.215) 0:00:54.453 ***** 2021-02-13T17:01:31.189 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-02-13T17:01:31.190 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1613235443, "cache_updated": false, "changed": false} 2021-02-13T17:01:31.235 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:31 +0000 (0:00:02.168) 0:00:56.622 ***** 2021-02-13T17:01:31.858 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-02-13T17:01:31.859 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1613235443, "cache_updated": false, "changed": false} 2021-02-13T17:01:31.897 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:31 +0000 (0:00:00.662) 0:00:57.284 ***** 2021-02-13T17:01:31.925 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-02-13T17:01:31.926 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:31.962 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:31 +0000 (0:00:00.064) 0:00:57.349 ***** 2021-02-13T17:01:32.033 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-02-13T17:01:32.034 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1613235472, "cache_updated": false, "changed": false} 2021-02-13T17:01:32.077 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:32 +0000 (0:00:00.114) 0:00:57.464 ***** 2021-02-13T17:01:32.532 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-02-13T17:01:32.570 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:32 +0000 (0:00:00.492) 0:00:57.956 ***** 2021-02-13T17:01:32.716 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1613235472, "cache_updated": false, "changed": false} 2021-02-13T17:01:32.761 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:32 +0000 (0:00:00.191) 0:00:58.148 ***** 2021-02-13T17:01:32.803 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-02-13T17:01:32.805 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:32.847 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:32 +0000 (0:00:00.085) 0:00:58.233 ***** 2021-02-13T17:01:33.132 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-02-13T17:01:33.134 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-02-13T17:01:33.180 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:33 +0000 (0:00:00.333) 0:00:58.567 ***** 2021-02-13T17:01:33.187 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-02-13T17:01:33.188 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1613235443, "cache_updated": false, "changed": false} 2021-02-13T17:01:33.232 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:33 +0000 (0:00:00.051) 0:00:58.619 ***** 2021-02-13T17:01:33.565 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-02-13T17:01:33.566 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-02-13T17:01:33.764 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-02-13T17:01:33.765 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1613235472, "cache_updated": false, "changed": false} 2021-02-13T17:01:33.802 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:33 +0000 (0:00:00.569) 0:00:59.188 ***** 2021-02-13T17:01:33.819 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-02-13T17:01:33.820 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-02-13T17:01:34.046 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-02-13T17:01:34.087 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:34 +0000 (0:00:00.285) 0:00:59.474 ***** 2021-02-13T17:01:34.157 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-02-13T17:01:34.189 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-02-13T17:01:34.191 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-02-13T17:01:34.225 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:34 +0000 (0:00:00.138) 0:00:59.612 ***** 2021-02-13T17:01:34.427 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-02-13T17:01:34.428 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-02-13T17:01:34.594 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-13T17:01:34.595 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": true, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "md5sum": "14041bf2666d8f8d277567958c7e9f69", "mode": "0755", "owner": "root", "size": 13355, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613235694.262008-91966682773405/source", "state": "file", "uid": 0} 2021-02-13T17:01:34.648 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-02-13T17:01:34.649 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-02-13T17:01:34.687 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:34 +0000 (0:00:00.461) 0:01:00.073 ***** 2021-02-13T17:01:34.787 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-02-13T17:01:34.788 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [gibba037.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-02-13T17:01:34.826 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:34 +0000 (0:00:00.139) 0:01:00.213 ***** 2021-02-13T17:01:34.963 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-02-13T17:01:35.007 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:35 +0000 (0:00:00.181) 0:01:00.394 ***** 2021-02-13T17:01:35.046 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-02-13T17:01:35.048 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-02-13T17:01:35.084 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:35 +0000 (0:00:00.076) 0:01:00.471 ***** 2021-02-13T17:01:35.101 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-13T17:01:35.103 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": true, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "md5sum": "14041bf2666d8f8d277567958c7e9f69", "mode": "0755", "owner": "root", "size": 13355, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613235694.85424-15316137705908/source", "state": "file", "uid": 0} 2021-02-13T17:01:35.113 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-02-13T17:01:35.115 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:35.152 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:35 +0000 (0:00:00.067) 0:01:00.538 ***** 2021-02-13T17:01:35.180 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-02-13T17:01:35.182 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:01:35.226 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:35 +0000 (0:00:00.074) 0:01:00.613 ***** 2021-02-13T17:01:35.275 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-02-13T17:01:35.277 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-13T17:01:35.287 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-13T17:01:35.298 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-13T17:01:35.299 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [gibba038.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-02-13T17:01:35.300 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [gibba037.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-13T17:01:35.351 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:35 +0000 (0:00:00.125) 0:01:00.738 ***** 2021-02-13T17:01:35.380 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-02-13T17:01:35.382 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:35.417 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:35 +0000 (0:00:00.065) 0:01:00.804 ***** 2021-02-13T17:01:35.487 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-13T17:01:35.489 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-02-13T17:01:35.528 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:35 +0000 (0:00:00.111) 0:01:00.915 ***** 2021-02-13T17:01:35.578 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-02-13T17:01:35.579 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-02-13T17:01:35.620 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:35 +0000 (0:00:00.091) 0:01:01.006 ***** 2021-02-13T17:01:35.646 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-02-13T17:01:35.648 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:35.682 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:35 +0000 (0:00:00.062) 0:01:01.069 ***** 2021-02-13T17:01:35.721 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:35.722 INFO:teuthology.task.ansible.out:TASK [common : Check for epel] ************************************************* 2021-02-13T17:01:35.724 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:01:35.761 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:35 +0000 (0:00:00.078) 0:01:01.148 ***** 2021-02-13T17:01:35.810 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-02-13T17:01:35.810 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-13T17:01:35.822 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-13T17:01:35.833 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-13T17:01:35.855 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-13T17:01:35.899 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:35 +0000 (0:00:00.137) 0:01:01.286 ***** 2021-02-13T17:01:35.939 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-02-13T17:01:35.940 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:35.975 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:35 +0000 (0:00:00.075) 0:01:01.362 ***** 2021-02-13T17:01:36.002 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-02-13T17:01:36.003 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1613235443, "cache_updated": false, "changed": false} 2021-02-13T17:01:36.042 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:36 +0000 (0:00:00.066) 0:01:01.429 ***** 2021-02-13T17:01:36.274 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-02-13T17:01:36.276 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-02-13T17:01:36.317 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:36 +0000 (0:00:00.274) 0:01:01.704 ***** 2021-02-13T17:01:36.561 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-02-13T17:01:36.563 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1613235472, "cache_updated": false, "changed": false} 2021-02-13T17:01:36.600 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:36 +0000 (0:00:00.282) 0:01:01.986 ***** 2021-02-13T17:01:36.623 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-02-13T17:01:36.624 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-02-13T17:01:36.666 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:36 +0000 (0:00:00.066) 0:01:02.052 ***** 2021-02-13T17:01:36.798 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-02-13T17:01:36.802 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-02-13T17:01:36.852 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-02-13T17:01:36.895 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:36 +0000 (0:00:00.229) 0:01:02.282 ***** 2021-02-13T17:01:36.902 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-02-13T17:01:36.902 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-02-13T17:01:36.949 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:36 +0000 (0:00:00.053) 0:01:02.336 ***** 2021-02-13T17:01:36.977 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-02-13T17:01:36.978 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:37.015 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:37 +0000 (0:00:00.065) 0:01:02.401 ***** 2021-02-13T17:01:37.050 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:37.052 INFO:teuthology.task.ansible.out:TASK [common : Check firewalld status] ***************************************** skipping: [gibba037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:01:37.088 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:37 +0000 (0:00:00.073) 0:01:02.475 ***** 2021-02-13T17:01:37.115 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-02-13T17:01:37.117 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:37.154 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:37 +0000 (0:00:00.065) 0:01:02.540 ***** 2021-02-13T17:01:37.162 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-02-13T17:01:37.162 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-02-13T17:01:37.204 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:37 +0000 (0:00:00.050) 0:01:02.591 ***** 2021-02-13T17:01:37.354 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [gibba038.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-02-13T17:01:37.399 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-02-13T17:01:37.400 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-02-13T17:01:37.445 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:37 +0000 (0:00:00.240) 0:01:02.832 ***** 2021-02-13T17:01:37.453 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-02-13T17:01:37.453 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-02-13T17:01:37.497 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:37 +0000 (0:00:00.051) 0:01:02.884 ***** 2021-02-13T17:01:37.540 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-02-13T17:01:37.541 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:37.577 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:37 +0000 (0:00:00.079) 0:01:02.963 ***** 2021-02-13T17:01:37.616 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-02-13T17:01:37.617 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:01:37.661 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:37 +0000 (0:00:00.084) 0:01:03.047 ***** 2021-02-13T17:01:37.702 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-02-13T17:01:37.704 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:37.741 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:37 +0000 (0:00:00.080) 0:01:03.128 ***** 2021-02-13T17:01:37.972 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-02-13T17:01:37.974 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-02-13T17:01:38.009 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:38 +0000 (0:00:00.266) 0:01:03.394 ***** 2021-02-13T17:01:38.073 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-02-13T17:01:38.074 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2021-02-13 17:00:18 UTC", "ActiveEnterTimestampMonotonic": "17447072", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target time-sync.target systemd-tmpfiles-setup.service sysinit.target system.slice nss-lookup.target network.target -.mount remote-fs.target basic.target systemd-journald.socket var-run.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2021-02-13 17:00:18 UTC", "AssertTimestampMonotonic": "17446420", "Before": "xdm.service getty@tty1.service shutdown.target plymouth-quit.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2021-02-13 17:00:18 UTC", "ConditionTimestampMonotonic": "17446420", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-serv 2021-02-13T17:01:38.075 INFO:teuthology.task.ansible.out:er.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1352", "ExecMainStartTimestamp": "Sat 2021-02-13 17:00:18 UTC", "ExecMainStartTimestampMonotonic": "17447055", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Sat 2021-02-13 17:00:18 UTC] ; stop_time=[n/a] ; pid=1352 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2021-02-13 17:00:18 UTC", "InactiveExitTimestampMonotonic": "17447072", "InvocationID": "77804c0247074284b30b91c0a58801fa", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "in 2021-02-13T17:01:38.077 INFO:teuthology.task.ansible.out:finity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128079", "LimitNPROCSoft": "128079", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128079", "LimitSIGPENDINGSoft": "128079", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1352", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2021-02-13T17:01:38.078 INFO:teuthology.task.ansible.out:"RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2021-02-13 17:00:18 UTC", "StateChangeTimestampMonotonic": "17447072", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2021-02-13 17:00:18 UTC", "WatchdogTimestampMonotonic": "17447072", "WatchdogUSec": "0"}} 2021-02-13T17:01:38.112 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:38 +0000 (0:00:00.104) 0:01:03.499 ***** 2021-02-13T17:01:38.142 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-02-13T17:01:38.145 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:38.181 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:38 +0000 (0:00:00.069) 0:01:03.568 ***** 2021-02-13T17:01:38.190 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-02-13T17:01:38.191 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2021-02-13 17:00:23 UTC", "ActiveEnterTimestampMonotonic": "17927119", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target system.slice basic.target systemd-journald.socket remote-fs.target local-fs.target time-sync.target -.mount network.target var-run.mount systemd-tmpfiles-setup.service sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2021-02-13 17:00:23 UTC", "AssertTimestampMonotonic": "17926436", "Before": "xdm.service plymouth-quit.service getty@tty1.service multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2021-02-13 17:00:23 UTC", "ConditionTimestampMonotonic": "17926436", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-serv 2021-02-13T17:01:38.193 INFO:teuthology.task.ansible.out:er.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1324", "ExecMainStartTimestamp": "Sat 2021-02-13 17:00:23 UTC", "ExecMainStartTimestampMonotonic": "17927097", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Sat 2021-02-13 17:00:23 UTC] ; stop_time=[n/a] ; pid=1324 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2021-02-13 17:00:23 UTC", "InactiveExitTimestampMonotonic": "17927119", "InvocationID": "f20848a44cc841daad874d4b17d1dc55", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "in 2021-02-13T17:01:38.194 INFO:teuthology.task.ansible.out:finity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128079", "LimitNPROCSoft": "128079", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128079", "LimitSIGPENDINGSoft": "128079", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1324", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2021-02-13T17:01:38.196 INFO:teuthology.task.ansible.out:"RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2021-02-13 17:00:23 UTC", "StateChangeTimestampMonotonic": "17927119", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2021-02-13 17:00:23 UTC", "WatchdogTimestampMonotonic": "17927119", "WatchdogUSec": "0"}} 2021-02-13T17:01:38.247 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:38 +0000 (0:00:00.065) 0:01:03.634 ***** 2021-02-13T17:01:38.257 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-02-13T17:01:38.259 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:38.297 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:38 +0000 (0:00:00.050) 0:01:03.684 ***** 2021-02-13T17:01:38.304 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-02-13T17:01:38.305 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:38.342 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:38 +0000 (0:00:00.044) 0:01:03.729 ***** 2021-02-13T17:01:38.349 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-02-13T17:01:38.351 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:38.401 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:38 +0000 (0:00:00.058) 0:01:03.787 ***** 2021-02-13T17:01:38.408 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-02-13T17:01:38.409 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:38.454 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:38 +0000 (0:00:00.052) 0:01:03.840 ***** 2021-02-13T17:01:38.460 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-02-13T17:01:38.461 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:38.508 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:38 +0000 (0:00:00.049) 0:01:03.890 ***** 2021-02-13T17:01:38.510 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-02-13T17:01:38.510 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:38.548 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:38 +0000 (0:00:00.044) 0:01:03.935 ***** 2021-02-13T17:01:38.555 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:38.723 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:38 +0000 (0:00:00.175) 0:01:04.110 ***** 2021-02-13T17:01:38.732 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-02-13T17:01:38.733 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:38.774 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:38 +0000 (0:00:00.050) 0:01:04.160 ***** 2021-02-13T17:01:38.781 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-02-13T17:01:38.783 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:38.823 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:38 +0000 (0:00:00.048) 0:01:04.209 ***** 2021-02-13T17:01:38.832 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-02-13T17:01:38.834 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:38.869 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:38 +0000 (0:00:00.046) 0:01:04.256 ***** 2021-02-13T17:01:38.877 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:38.920 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:38 +0000 (0:00:00.050) 0:01:04.307 ***** 2021-02-13T17:01:38.928 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-02-13T17:01:38.929 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:38.969 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:38 +0000 (0:00:00.049) 0:01:04.356 ***** 2021-02-13T17:01:38.975 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-02-13T17:01:38.976 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:39.014 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:39 +0000 (0:00:00.045) 0:01:04.401 ***** 2021-02-13T17:01:39.021 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-02-13T17:01:39.022 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:39.063 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:39 +0000 (0:00:00.048) 0:01:04.449 ***** 2021-02-13T17:01:39.071 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-02-13T17:01:39.072 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:39.122 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:39 +0000 (0:00:00.058) 0:01:04.508 ***** 2021-02-13T17:01:39.129 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-02-13T17:01:39.130 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:39.174 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:39 +0000 (0:00:00.047) 0:01:04.556 ***** 2021-02-13T17:01:39.177 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-02-13T17:01:39.179 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:39.221 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:39 +0000 (0:00:00.052) 0:01:04.608 ***** 2021-02-13T17:01:39.229 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-02-13T17:01:39.231 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:39.287 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:39 +0000 (0:00:00.065) 0:01:04.673 ***** 2021-02-13T17:01:39.295 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-02-13T17:01:39.295 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-02-13T17:01:39.340 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:39 +0000 (0:00:00.053) 0:01:04.727 ***** 2021-02-13T17:01:39.348 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-02-13T17:01:39.350 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:39.393 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:39 +0000 (0:00:00.052) 0:01:04.779 ***** 2021-02-13T17:01:39.403 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-02-13T17:01:39.404 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-02-13T17:01:39.450 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:39 +0000 (0:00:00.057) 0:01:04.837 ***** 2021-02-13T17:01:39.458 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-02-13T17:01:39.459 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-02-13T17:01:39.501 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:39 +0000 (0:00:00.050) 0:01:04.887 ***** 2021-02-13T17:01:39.507 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-02-13T17:01:39.508 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-02-13T17:01:39.562 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:39 +0000 (0:00:00.060) 0:01:04.948 ***** 2021-02-13T17:01:39.568 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-02-13T17:01:39.569 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-02-13T17:01:39.612 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:39 +0000 (0:00:00.050) 0:01:04.999 ***** 2021-02-13T17:01:39.618 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-02-13T17:01:39.618 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-02-13T17:01:39.661 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:39 +0000 (0:00:00.049) 0:01:05.048 ***** 2021-02-13T17:01:39.679 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-02-13T17:01:39.680 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-02-13T17:01:39.719 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:39 +0000 (0:00:00.057) 0:01:05.106 ***** 2021-02-13T17:01:39.769 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-02-13T17:01:39.771 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-02-13T17:01:39.808 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:39 +0000 (0:00:00.089) 0:01:05.195 ***** 2021-02-13T17:01:39.852 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:39 +0000 (0:00:00.044) 0:01:05.239 ***** 2021-02-13T17:01:39.922 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-02-13T17:01:39.924 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "name": "ubuntu", "state": "present", "system": false} 2021-02-13T17:01:39.961 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:39 +0000 (0:00:00.108) 0:01:05.348 ***** 2021-02-13T17:01:39.979 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:39.979 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-02-13T17:01:39.981 INFO:teuthology.task.ansible.out: ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-02-13T17:01:40.020 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:40 +0000 (0:00:00.057) 0:01:05.406 ***** 2021-02-13T17:01:40.029 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-02-13T17:01:40.030 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:40.072 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:40 +0000 (0:00:00.053) 0:01:05.459 ***** 2021-02-13T17:01:40.100 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-02-13T17:01:40.101 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:40.145 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:40 +0000 (0:00:00.073) 0:01:05.532 ***** 2021-02-13T17:01:40.153 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-02-13T17:01:40.155 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "name": "ubuntu", "state": "present", "system": false} 2021-02-13T17:01:40.200 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:40 +0000 (0:00:00.052) 0:01:05.584 ***** 2021-02-13T17:01:40.226 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-02-13T17:01:40.227 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:40.270 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:40 +0000 (0:00:00.072) 0:01:05.657 ***** 2021-02-13T17:01:40.277 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-02-13T17:01:40.279 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-02-13T17:01:40.331 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:40 +0000 (0:00:00.060) 0:01:05.718 ***** 2021-02-13T17:01:40.340 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-02-13T17:01:40.341 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:40.378 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:40 +0000 (0:00:00.046) 0:01:05.764 ***** 2021-02-13T17:01:40.537 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [gibba038.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-02-13T17:01:40.574 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:40 +0000 (0:00:00.196) 0:01:05.961 ***** 2021-02-13T17:01:40.697 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-02-13T17:01:40.698 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-02-13T17:01:40.750 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:40 +0000 (0:00:00.171) 0:01:06.132 ***** 2021-02-13T17:01:40.798 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-02-13T17:01:40.799 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba037"}, "changed": false} 2021-02-13T17:01:40.834 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:40 +0000 (0:00:00.088) 0:01:06.220 ***** 2021-02-13T17:01:40.925 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-02-13T17:01:40.926 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-02-13T17:01:40.966 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:40 +0000 (0:00:00.132) 0:01:06.353 ***** 2021-02-13T17:01:41.015 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-02-13T17:01:41.016 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba038"}, "changed": false} 2021-02-13T17:01:41.061 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:41 +0000 (0:00:00.094) 0:01:06.448 ***** 2021-02-13T17:01:41.572 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-02-13T17:01:41.574 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba037.front.sepia.ceph.com", "ansible_hostname": "gibba037", "ansible_nodename": "gibba037"}, "changed": true, "name": "gibba037"} 2021-02-13T17:01:41.641 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:41 +0000 (0:00:00.579) 0:01:07.028 ***** 2021-02-13T17:01:41.649 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba038.front.sepia.ceph.com", "ansible_hostname": "gibba038", "ansible_nodename": "gibba038"}, "changed": true, "name": "gibba038"} 2021-02-13T17:01:41.691 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:41 +0000 (0:00:00.050) 0:01:07.078 ***** 2021-02-13T17:01:41.919 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-02-13T17:01:41.920 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-02-13T17:01:41.962 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:41 +0000 (0:00:00.268) 0:01:07.347 ***** 2021-02-13T17:01:41.982 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-02-13T17:01:42.022 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:42 +0000 (0:00:00.061) 0:01:07.408 ***** 2021-02-13T17:01:42.258 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-02-13T17:01:42.314 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:42 +0000 (0:00:00.292) 0:01:07.701 ***** 2021-02-13T17:01:42.327 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-02-13T17:01:42.375 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:42 +0000 (0:00:00.060) 0:01:07.761 ***** 2021-02-13T17:01:42.781 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:42.782 INFO:teuthology.task.ansible.out:TASK [testnode : Add ssh pubkeys] ********************************************** changed: [gibba037.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-02-13T17:01:42.819 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:42 +0000 (0:00:00.444) 0:01:08.206 ***** 2021-02-13T17:01:42.847 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:42.893 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:42 +0000 (0:00:00.073) 0:01:08.279 ***** 2021-02-13T17:01:42.900 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-02-13T17:01:42.901 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-02-13T17:01:42.939 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:42 +0000 (0:00:00.046) 0:01:08.326 ***** 2021-02-13T17:01:42.946 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-13T17:01:42.947 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:42.983 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:42 +0000 (0:00:00.043) 0:01:08.370 ***** 2021-02-13T17:01:42.983 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:42.991 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:42.993 INFO:teuthology.task.ansible.out:TASK [testnode : Create remote.conf] ******************************************* skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:43.034 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:43 +0000 (0:00:00.051) 0:01:08.421 ***** 2021-02-13T17:01:43.041 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-13T17:01:43.042 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:43.085 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:43 +0000 (0:00:00.050) 0:01:08.471 ***** 2021-02-13T17:01:43.094 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-13T17:01:43.095 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:43.132 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:43 +0000 (0:00:00.047) 0:01:08.519 ***** 2021-02-13T17:01:43.139 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:43.141 INFO:teuthology.task.ansible.out:TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:43.185 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:43 +0000 (0:00:00.052) 0:01:08.572 ***** 2021-02-13T17:01:43.192 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-13T17:01:43.193 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:43.241 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:43 +0000 (0:00:00.055) 0:01:08.628 ***** 2021-02-13T17:01:43.248 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-13T17:01:43.249 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:43.293 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:43 +0000 (0:00:00.052) 0:01:08.680 ***** 2021-02-13T17:01:43.304 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:43.351 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:43 +0000 (0:00:00.057) 0:01:08.738 ***** 2021-02-13T17:01:43.358 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-13T17:01:43.360 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:43.406 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:43 +0000 (0:00:00.055) 0:01:08.793 ***** 2021-02-13T17:01:43.416 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-13T17:01:43.418 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:43.461 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:43 +0000 (0:00:00.055) 0:01:08.848 ***** 2021-02-13T17:01:43.468 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-13T17:01:43.468 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:43.507 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:43 +0000 (0:00:00.045) 0:01:08.894 ***** 2021-02-13T17:01:43.514 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-13T17:01:43.516 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:43.555 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:43 +0000 (0:00:00.047) 0:01:08.941 ***** 2021-02-13T17:01:43.561 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-02-13T17:01:43.563 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:43.606 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:43 +0000 (0:00:00.051) 0:01:08.993 ***** 2021-02-13T17:01:43.615 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:43.654 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:43 +0000 (0:00:00.047) 0:01:09.040 ***** 2021-02-13T17:01:43.660 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-02-13T17:01:43.708 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:43 +0000 (0:00:00.054) 0:01:09.095 ***** 2021-02-13T17:01:43.715 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-02-13T17:01:43.716 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:43.754 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:43 +0000 (0:00:00.046) 0:01:09.141 ***** 2021-02-13T17:01:43.761 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-02-13T17:01:43.801 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:43 +0000 (0:00:00.046) 0:01:09.188 ***** 2021-02-13T17:01:43.808 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-02-13T17:01:43.847 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:43 +0000 (0:00:00.045) 0:01:09.234 ***** 2021-02-13T17:01:43.855 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-02-13T17:01:43.895 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:43 +0000 (0:00:00.048) 0:01:09.282 ***** 2021-02-13T17:01:43.903 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-02-13T17:01:43.945 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:43 +0000 (0:00:00.049) 0:01:09.332 ***** 2021-02-13T17:01:43.960 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-02-13T17:01:43.962 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.001 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:43 +0000 (0:00:00.056) 0:01:09.388 ***** 2021-02-13T17:01:44.012 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-02-13T17:01:44.055 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:44 +0000 (0:00:00.053) 0:01:09.442 ***** 2021-02-13T17:01:44.062 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-02-13T17:01:44.063 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.106 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:44 +0000 (0:00:00.050) 0:01:09.493 ***** 2021-02-13T17:01:44.112 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-02-13T17:01:44.114 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.151 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:44 +0000 (0:00:00.045) 0:01:09.538 ***** 2021-02-13T17:01:44.158 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-02-13T17:01:44.158 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.199 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:44 +0000 (0:00:00.048) 0:01:09.586 ***** 2021-02-13T17:01:44.207 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-02-13T17:01:44.208 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.209 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.248 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:44 +0000 (0:00:00.048) 0:01:09.634 ***** 2021-02-13T17:01:44.254 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:01:44.255 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.292 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:44 +0000 (0:00:00.044) 0:01:09.679 ***** 2021-02-13T17:01:44.294 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:44.301 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-02-13T17:01:44.303 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.341 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:44 +0000 (0:00:00.047) 0:01:09.727 ***** 2021-02-13T17:01:44.347 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-02-13T17:01:44.348 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.385 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:44 +0000 (0:00:00.044) 0:01:09.772 ***** 2021-02-13T17:01:44.386 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:44.392 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:01:44.393 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.394 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:44.432 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:44 +0000 (0:00:00.047) 0:01:09.819 ***** 2021-02-13T17:01:44.439 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-02-13T17:01:44.440 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.491 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:44 +0000 (0:00:00.059) 0:01:09.878 ***** 2021-02-13T17:01:44.498 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-02-13T17:01:44.499 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.537 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:44 +0000 (0:00:00.046) 0:01:09.924 ***** 2021-02-13T17:01:44.543 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-02-13T17:01:44.545 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.583 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:44 +0000 (0:00:00.045) 0:01:09.970 ***** 2021-02-13T17:01:44.592 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-02-13T17:01:44.593 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.630 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:44 +0000 (0:00:00.047) 0:01:10.017 ***** 2021-02-13T17:01:44.637 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-02-13T17:01:44.638 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.682 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:44 +0000 (0:00:00.051) 0:01:10.069 ***** 2021-02-13T17:01:44.692 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-02-13T17:01:44.693 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.730 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:44 +0000 (0:00:00.047) 0:01:10.117 ***** 2021-02-13T17:01:44.738 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-13T17:01:44.739 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.780 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:44 +0000 (0:00:00.049) 0:01:10.166 ***** 2021-02-13T17:01:44.787 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-02-13T17:01:44.788 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.827 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:44 +0000 (0:00:00.047) 0:01:10.214 ***** 2021-02-13T17:01:44.834 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-13T17:01:44.835 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.872 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:44 +0000 (0:00:00.044) 0:01:10.259 ***** 2021-02-13T17:01:44.880 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-13T17:01:44.881 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.920 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:44 +0000 (0:00:00.048) 0:01:10.307 ***** 2021-02-13T17:01:44.928 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-13T17:01:44.929 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:44.969 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:44 +0000 (0:00:00.048) 0:01:10.356 ***** 2021-02-13T17:01:44.982 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.017 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.046) 0:01:10.403 ***** 2021-02-13T17:01:45.025 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-02-13T17:01:45.027 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.064 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.047) 0:01:10.450 ***** 2021-02-13T17:01:45.070 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-13T17:01:45.072 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.109 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.045) 0:01:10.496 ***** 2021-02-13T17:01:45.116 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-13T17:01:45.117 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.156 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.046) 0:01:10.543 ***** 2021-02-13T17:01:45.163 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.201 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.044) 0:01:10.587 ***** 2021-02-13T17:01:45.207 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-13T17:01:45.208 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.244 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.042) 0:01:10.630 ***** 2021-02-13T17:01:45.250 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-13T17:01:45.251 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.288 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.044) 0:01:10.675 ***** 2021-02-13T17:01:45.297 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-02-13T17:01:45.298 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.336 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.048) 0:01:10.723 ***** 2021-02-13T17:01:45.344 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-13T17:01:45.345 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.386 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.049) 0:01:10.773 ***** 2021-02-13T17:01:45.392 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-02-13T17:01:45.394 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.439 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.052) 0:01:10.826 ***** 2021-02-13T17:01:45.448 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-02-13T17:01:45.449 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.486 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.047) 0:01:10.873 ***** 2021-02-13T17:01:45.494 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-02-13T17:01:45.495 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.534 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.047) 0:01:10.921 ***** 2021-02-13T17:01:45.541 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-02-13T17:01:45.542 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.579 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.044) 0:01:10.965 ***** 2021-02-13T17:01:45.586 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-02-13T17:01:45.587 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.624 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.045) 0:01:11.011 ***** 2021-02-13T17:01:45.631 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-02-13T17:01:45.632 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.671 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.047) 0:01:11.058 ***** 2021-02-13T17:01:45.678 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-02-13T17:01:45.680 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.716 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.045) 0:01:11.103 ***** 2021-02-13T17:01:45.724 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-02-13T17:01:45.726 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.761 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.044) 0:01:11.147 ***** 2021-02-13T17:01:45.767 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-02-13T17:01:45.768 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.805 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.044) 0:01:11.191 ***** 2021-02-13T17:01:45.811 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-02-13T17:01:45.813 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.849 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.043) 0:01:11.235 ***** 2021-02-13T17:01:45.854 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-02-13T17:01:45.856 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.894 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.045) 0:01:11.281 ***** 2021-02-13T17:01:45.901 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-02-13T17:01:45.902 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.938 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.043) 0:01:11.325 ***** 2021-02-13T17:01:45.945 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-02-13T17:01:45.946 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:45.982 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:45 +0000 (0:00:00.044) 0:01:11.369 ***** 2021-02-13T17:01:45.990 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-02-13T17:01:45.991 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:46.027 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:46 +0000 (0:00:00.044) 0:01:11.414 ***** 2021-02-13T17:01:46.065 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-02-13T17:01:46.066 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:46.105 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:46 +0000 (0:00:00.078) 0:01:11.492 ***** 2021-02-13T17:01:46.112 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-02-13T17:01:46.113 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001348", "end": "2021-02-13 17:01:46.064078", "rc": 0, "start": "2021-02-13 17:01:46.062730", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:01:46.153 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:46 +0000 (0:00:00.047) 0:01:11.540 ***** 2021-02-13T17:01:46.181 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-02-13T17:01:46.217 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:46 +0000 (0:00:00.064) 0:01:11.604 ***** 2021-02-13T17:01:46.219 INFO:teuthology.task.ansible.out: 2021-02-13T17:01:46.227 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-02-13T17:01:46.228 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001291", "end": "2021-02-13 17:01:46.050217", "rc": 0, "start": "2021-02-13 17:01:46.048926", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:01:46.267 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:46 +0000 (0:00:00.049) 0:01:11.654 ***** 2021-02-13T17:01:46.295 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-02-13T17:01:46.334 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:46 +0000 (0:00:00.066) 0:01:11.721 ***** 2021-02-13T17:01:46.450 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-02-13T17:01:46.451 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-02-13T17:01:46.490 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:46 +0000 (0:00:00.155) 0:01:11.876 ***** 2021-02-13T17:01:46.529 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-02-13T17:01:46.530 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:46.575 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:46 +0000 (0:00:00.085) 0:01:11.961 ***** 2021-02-13T17:01:46.582 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-02-13T17:01:46.583 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-02-13T17:01:46.621 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:46 +0000 (0:00:00.046) 0:01:12.008 ***** 2021-02-13T17:01:46.649 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:01:46.688 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:46 +0000 (0:00:00.066) 0:01:12.074 ***** 2021-02-13T17:01:47.535 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-02-13T17:01:47.536 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-02-13T17:01:47.577 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-02-13T17:01:48.203 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-02-13T17:01:48.239 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:48 +0000 (0:00:01.551) 0:01:13.626 ***** 2021-02-13T17:01:48.308 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-02-13T17:01:48.347 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:48 +0000 (0:00:00.107) 0:01:13.734 ***** 2021-02-13T17:01:48.869 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-02-13T17:01:48.870 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1613235472, "cache_updated": false, "changed": false} 2021-02-13T17:01:48.910 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:48 +0000 (0:00:00.563) 0:01:14.297 ***** 2021-02-13T17:01:48.938 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-02-13T17:01:48.979 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:48 +0000 (0:00:00.068) 0:01:14.365 ***** 2021-02-13T17:01:48.987 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-02-13T17:01:48.987 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1613235443, "cache_updated": false, "changed": false} 2021-02-13T17:01:49.028 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:49 +0000 (0:00:00.049) 0:01:14.415 ***** 2021-02-13T17:01:49.055 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-02-13T17:01:49.095 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:49 +0000 (0:00:00.067) 0:01:14.482 ***** 2021-02-13T17:01:49.102 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-02-13T17:01:49.103 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.013529", "end": "2021-02-13 17:01:48.943070", "rc": 0, "start": "2021-02-13 17:01:48.929541", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:01:49.141 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:49 +0000 (0:00:00.045) 0:01:14.527 ***** 2021-02-13T17:01:49.210 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.013660", "end": "2021-02-13 17:01:49.186390", "rc": 0, "start": "2021-02-13 17:01:49.172730", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:01:49.249 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:49 +0000 (0:00:00.107) 0:01:14.635 ***** 2021-02-13T17:01:51.167 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-02-13T17:01:51.169 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1613235472, "cache_updated": false, "changed": false} 2021-02-13T17:01:51.205 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:51 +0000 (0:00:01.956) 0:01:16.591 ***** 2021-02-13T17:01:51.327 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1613235443, "cache_updated": false, "changed": false} 2021-02-13T17:01:51.366 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:51 +0000 (0:00:00.161) 0:01:16.753 ***** 2021-02-13T17:01:58.708 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-02-13T17:01:58.709 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 82 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137602 files and directories 2021-02-13T17:01:58.710 INFO:teuthology.task.ansible.out: currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 82 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readi 2021-02-13T17:01:58.712 INFO:teuthology.task.ansible.out:ng database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137602 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2021-02-13T17:01:58.747 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:58 +0000 (0:00:07.381) 0:01:24.134 ***** 2021-02-13T17:01:58.975 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 82 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137602 files and directories 2021-02-13T17:01:58.976 INFO:teuthology.task.ansible.out: currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 82 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readi 2021-02-13T17:01:58.978 INFO:teuthology.task.ansible.out:ng database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137602 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2021-02-13T17:01:59.013 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:01:59 +0000 (0:00:00.265) 0:01:24.400 ***** 2021-02-13T17:02:06.595 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-13T17:02:06.596 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1613235472, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apt-utils libapt-pkg5.0\nSuggested packages:\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apt apt-utils libapt-pkg5.0\n3 upgraded, 0 newly installed, 0 to remove and 79 not upgraded.\nNeed to get 2214 kB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libapt-pkg5.0 amd64 1.6.12ubuntu0.2 [806 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt amd64 1.6.12ubuntu0.2 [1201 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt-utils amd64 1.6.12ubuntu0.2 [207 kB]\nFetched 2214 kB in 1s (2546 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 1 2021-02-13T17:02:06.597 INFO:teuthology.task.ansible.out:0%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137460 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg5.0_1.6.12ubuntu0.2_amd64.deb ...\r\nUnpacking libapt-pkg5.0:amd64 (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...\r\nSetting up libapt-pkg5.0:amd64 (1.6.12ubuntu0.2) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137460 files and directories currently installed.)\r\nPreparing to unpack .../apt_1.6.12ubuntu0.2_amd64.deb ...\r\nUnpacking apt (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...\r\nSetting up apt (1.6.12ubuntu0.2) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75 2021-02-13T17:02:06.598 INFO:teuthology.task.ansible.out:%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137460 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_1.6.12ubuntu0.2_amd64.deb ...\r\nUnpacking apt-utils (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...\r\nSetting up apt-utils (1.6.12ubuntu0.2) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apt-utils libapt-pkg5.0", "Suggested packages:", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apt apt-utils libapt-pkg5.0", "3 upgraded, 0 newly installed, 0 to remove and 79 not upgraded.", "Need to get 2214 kB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libapt-pkg5.0 amd64 1.6.12ubuntu0.2 [806 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt am 2021-02-13T17:02:06.600 INFO:teuthology.task.ansible.out:d64 1.6.12ubuntu0.2 [1201 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt-utils amd64 1.6.12ubuntu0.2 [207 kB]", "Fetched 2214 kB in 1s (2546 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137460 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg5.0_1.6.12ubuntu0.2_amd64.deb ...", "Unpacking libapt-pkg5.0:amd64 (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...", "Setting up libapt-pkg5.0:amd64 (1.6.12ubuntu0.2) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137460 files and directories currently installed.)", "Preparing to unpack .../apt_1.6.12ubuntu0.2_amd64.deb ...", "Unpacking apt (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...", "Setting up apt (1.6.12ubuntu0.2) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Readi 2021-02-13T17:02:06.601 INFO:teuthology.task.ansible.out:ng database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45 2021-02-13T17:02:06.601 INFO:teuthology.task.ansible.out:%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137460 files and directories currently installed.)", "Preparing to unpack .../apt-utils_1.6.12ubuntu0.2_amd64.deb ...", "Unpacking apt-utils (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...", "Setting up apt-utils (1.6.12ubuntu0.2) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2021-02-13T17:02:06.640 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:06 +0000 (0:00:07.626) 0:01:32.027 ***** 2021-02-13T17:02:06.668 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:06.703 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:06 +0000 (0:00:00.063) 0:01:32.090 ***** 2021-02-13T17:02:07.018 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-13T17:02:07.019 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1613235443, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apt-utils libapt-pkg5.0\nSuggested packages:\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apt apt-utils libapt-pkg5.0\n3 upgraded, 0 newly installed, 0 to remove and 79 not upgraded.\nNeed to get 2214 kB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libapt-pkg5.0 amd64 1.6.12ubuntu0.2 [806 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt amd64 1.6.12ubuntu0.2 [1201 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt-utils amd64 1.6.12ubuntu0.2 [207 kB]\nFetched 2214 kB in 1s (2615 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 1 2021-02-13T17:02:07.020 INFO:teuthology.task.ansible.out:0%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137460 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg5.0_1.6.12ubuntu0.2_amd64.deb ...\r\nUnpacking libapt-pkg5.0:amd64 (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...\r\nSetting up libapt-pkg5.0:amd64 (1.6.12ubuntu0.2) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137460 files and directories currently installed.)\r\nPreparing to unpack .../apt_1.6.12ubuntu0.2_amd64.deb ...\r\nUnpacking apt (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...\r\nSetting up apt (1.6.12ubuntu0.2) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75 2021-02-13T17:02:07.021 INFO:teuthology.task.ansible.out:%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137460 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_1.6.12ubuntu0.2_amd64.deb ...\r\nUnpacking apt-utils (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...\r\nSetting up apt-utils (1.6.12ubuntu0.2) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apt-utils libapt-pkg5.0", "Suggested packages:", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apt apt-utils libapt-pkg5.0", "3 upgraded, 0 newly installed, 0 to remove and 79 not upgraded.", "Need to get 2214 kB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libapt-pkg5.0 amd64 1.6.12ubuntu0.2 [806 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt am 2021-02-13T17:02:07.023 INFO:teuthology.task.ansible.out:d64 1.6.12ubuntu0.2 [1201 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt-utils amd64 1.6.12ubuntu0.2 [207 kB]", "Fetched 2214 kB in 1s (2615 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137460 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg5.0_1.6.12ubuntu0.2_amd64.deb ...", "Unpacking libapt-pkg5.0:amd64 (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...", "Setting up libapt-pkg5.0:amd64 (1.6.12ubuntu0.2) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137460 files and directories currently installed.)", "Preparing to unpack .../apt_1.6.12ubuntu0.2_amd64.deb ...", "Unpacking apt (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...", "Setting up apt (1.6.12ubuntu0.2) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Readi 2021-02-13T17:02:07.024 INFO:teuthology.task.ansible.out:ng database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137460 files and directories currently installed.)", "Preparing to unpack .../apt-utils_1.6.12ubuntu0.2_amd64.deb ...", "Unpacking apt-utils (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...", "Setting up apt-utils (1.6.12ubuntu0.2) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2021-02-13T17:02:07.057 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:07 +0000 (0:00:00.353) 0:01:32.444 ***** 2021-02-13T17:02:07.088 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-02-13T17:02:07.089 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:07.124 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:07 +0000 (0:00:00.066) 0:01:32.510 ***** 2021-02-13T17:02:14.228 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-13T17:02:14.229 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1613235472, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 79 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.35 [40.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.35 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.35 [5194 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.35 [868 kB]\nFetched 10.4 MB in 1s (9575 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 2021-02-13T17:02:14.230 INFO:teuthology.task.ansible.out: 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137460 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu 2021-02-13T17:02:14.231 INFO:teuthology.task.ansible.out:1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 79 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.35 [40.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.35 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.35 [5194 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.35 [868 kB]", "Fetched 10.4 MB in 1s (9575 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Re 2021-02-13T17:02:14.232 INFO:teuthology.task.ansible.out:ading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137460 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2021-02-13T17:02:14.268 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:14 +0000 (0:00:07.143) 0:01:39.654 ***** 2021-02-13T17:02:14.531 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1613235443, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 79 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.35 [40.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.35 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.35 [5194 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.35 [868 kB]\nFetched 10.4 MB in 1s (9531 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 2021-02-13T17:02:14.533 INFO:teuthology.task.ansible.out: 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137460 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu 2021-02-13T17:02:14.534 INFO:teuthology.task.ansible.out:1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 79 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.35 [40.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.35 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.35 [5194 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.35 [868 kB]", "Fetched 10.4 MB in 1s (9531 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Re 2021-02-13T17:02:14.535 INFO:teuthology.task.ansible.out:ading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137460 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2021-02-13T17:02:14.577 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:14 +0000 (0:00:00.308) 0:01:39.963 ***** 2021-02-13T17:02:14.840 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-02-13T17:02:14.842 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1613235472, "cache_updated": false, "changed": false} 2021-02-13T17:02:14.878 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:14 +0000 (0:00:00.300) 0:01:40.264 ***** 2021-02-13T17:02:14.978 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-02-13T17:02:14.980 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-02-13T17:02:15.014 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:15 +0000 (0:00:00.136) 0:01:40.401 ***** 2021-02-13T17:02:15.041 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-02-13T17:02:15.043 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:15.078 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:15 +0000 (0:00:00.063) 0:01:40.465 ***** 2021-02-13T17:02:15.159 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-02-13T17:02:15.161 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1613235443, "cache_updated": false, "changed": false} 2021-02-13T17:02:15.215 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:15 +0000 (0:00:00.137) 0:01:40.602 ***** 2021-02-13T17:02:15.222 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-02-13T17:02:15.223 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-02-13T17:02:15.262 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:15 +0000 (0:00:00.046) 0:01:40.649 ***** 2021-02-13T17:02:15.312 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-02-13T17:02:15.313 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-02-13T17:02:15.351 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:15 +0000 (0:00:00.088) 0:01:40.737 ***** 2021-02-13T17:02:15.377 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-02-13T17:02:15.378 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:15.413 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:15 +0000 (0:00:00.062) 0:01:40.800 ***** 2021-02-13T17:02:15.502 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-02-13T17:02:15.504 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-02-13T17:02:15.542 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:15 +0000 (0:00:00.129) 0:01:40.929 ***** 2021-02-13T17:02:15.549 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-02-13T17:02:15.549 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-02-13T17:02:15.587 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:15 +0000 (0:00:00.044) 0:01:40.973 ***** 2021-02-13T17:02:15.656 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-02-13T17:02:15.658 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1234, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-02-13T17:02:15.695 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:15 +0000 (0:00:00.108) 0:01:41.082 ***** 2021-02-13T17:02:15.838 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-02-13T17:02:15.840 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-13T17:02:15.875 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:15 +0000 (0:00:00.179) 0:01:41.262 ***** 2021-02-13T17:02:15.882 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-02-13T17:02:15.883 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-02-13T17:02:15.922 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:15 +0000 (0:00:00.046) 0:01:41.308 ***** 2021-02-13T17:02:16.033 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-02-13T17:02:16.034 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1234, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-02-13T17:02:16.071 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:16 +0000 (0:00:00.149) 0:01:41.458 ***** 2021-02-13T17:02:16.121 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-02-13T17:02:16.122 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Sat 2021-02-13 17:00:23 UTC", "ActiveEnterTimestampMonotonic": "18210633", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target nss-lookup.target systemd-journald.socket network.target systemd-tmpfiles-setup.service system.slice remote-fs.target sysinit.target -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2021-02-13 17:00:23 UTC", "AssertTimestampMonotonic": "17925486", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2021-02-13 17:00:23 UTC", "ConditionTimestampMonotonic": "17925486", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "D 2021-02-13T17:02:16.123 INFO:teuthology.task.ansible.out:ropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1388", "ExecMainStartTimestamp": "Sat 2021-02-13 17:00:23 UTC", "ExecMainStartTimestampMonotonic": "18210625", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2021-02-13 17:00:23 UTC", "InactiveExitTimestampMonotonic": "17925897", "InvocationID": "ce66aee7d7a94b0c98b77a1fa310c51e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft 2021-02-13T17:02:16.125 INFO:teuthology.task.ansible.out:": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128079", "LimitNPROCSoft": "128079", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128079", "LimitSIGPENDINGSoft": "128079", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1388", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGH 2021-02-13T17:02:16.126 INFO:teuthology.task.ansible.out:UP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2021-02-13 17:00:23 UTC", "StateChangeTimestampMonotonic": "18210633", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2021-02-13 17:00:23 UTC", "WatchdogTimestampMonotonic": "18210632", "WatchdogUSec": "0"}} 2021-02-13T17:02:16.160 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:16 +0000 (0:00:00.089) 0:01:41.547 ***** 2021-02-13T17:02:16.178 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-02-13T17:02:16.180 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-13T17:02:16.217 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:16 +0000 (0:00:00.056) 0:01:41.604 ***** 2021-02-13T17:02:16.226 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-13T17:02:16.227 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:16.284 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:16 +0000 (0:00:00.065) 0:01:41.670 ***** 2021-02-13T17:02:16.311 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-13T17:02:16.313 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:16.348 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:16 +0000 (0:00:00.064) 0:01:41.735 ***** 2021-02-13T17:02:16.376 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-13T17:02:16.377 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:16.414 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:16 +0000 (0:00:00.065) 0:01:41.800 ***** 2021-02-13T17:02:16.441 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:16.485 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:16 +0000 (0:00:00.071) 0:01:41.872 ***** 2021-02-13T17:02:16.492 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-02-13T17:02:16.494 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Sat 2021-02-13 17:00:19 UTC", "ActiveEnterTimestampMonotonic": "17697916", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service network.target -.mount sysinit.target nss-lookup.target system.slice basic.target remote-fs.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2021-02-13 17:00:18 UTC", "AssertTimestampMonotonic": "17447900", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2021-02-13 17:00:18 UTC", "ConditionTimestampMonotonic": "17447900", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "D 2021-02-13T17:02:16.495 INFO:teuthology.task.ansible.out:ropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1432", "ExecMainStartTimestamp": "Sat 2021-02-13 17:00:19 UTC", "ExecMainStartTimestampMonotonic": "17697908", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2021-02-13 17:00:18 UTC", "InactiveExitTimestampMonotonic": "17448696", "InvocationID": "4879bb9b85bc479eb5383992da1e2db2", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft 2021-02-13T17:02:16.497 INFO:teuthology.task.ansible.out:": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128079", "LimitNPROCSoft": "128079", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128079", "LimitSIGPENDINGSoft": "128079", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1432", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGH 2021-02-13T17:02:16.498 INFO:teuthology.task.ansible.out:UP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2021-02-13 17:00:19 UTC", "StateChangeTimestampMonotonic": "17697916", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2021-02-13 17:00:19 UTC", "WatchdogTimestampMonotonic": "17697915", "WatchdogUSec": "0"}} 2021-02-13T17:02:16.533 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:16 +0000 (0:00:00.047) 0:01:41.920 ***** 2021-02-13T17:02:16.541 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-13T17:02:16.542 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:16.577 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:16 +0000 (0:00:00.043) 0:01:41.963 ***** 2021-02-13T17:02:16.582 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-13T17:02:16.584 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:16.619 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:16 +0000 (0:00:00.042) 0:01:42.006 ***** 2021-02-13T17:02:16.626 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-13T17:02:16.627 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:16.667 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:16 +0000 (0:00:00.047) 0:01:42.053 ***** 2021-02-13T17:02:16.673 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-13T17:02:16.674 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:16.712 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:16 +0000 (0:00:00.045) 0:01:42.099 ***** 2021-02-13T17:02:16.719 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-13T17:02:16.721 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:16.756 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:16 +0000 (0:00:00.043) 0:01:42.143 ***** 2021-02-13T17:02:16.762 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-13T17:02:16.763 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:16.798 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:16 +0000 (0:00:00.042) 0:01:42.185 ***** 2021-02-13T17:02:16.809 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-13T17:02:16.810 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:16.845 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:16 +0000 (0:00:00.046) 0:01:42.231 ***** 2021-02-13T17:02:16.851 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-13T17:02:16.853 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:16.889 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:16 +0000 (0:00:00.044) 0:01:42.276 ***** 2021-02-13T17:02:16.895 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:02:16.897 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:16.932 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:16 +0000 (0:00:00.043) 0:01:42.319 ***** 2021-02-13T17:02:16.938 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-13T17:02:16.939 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:16.975 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:16 +0000 (0:00:00.043) 0:01:42.362 ***** 2021-02-13T17:02:16.981 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-13T17:02:16.983 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.018 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.042) 0:01:42.405 ***** 2021-02-13T17:02:17.024 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-13T17:02:17.025 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.060 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.041) 0:01:42.447 ***** 2021-02-13T17:02:17.067 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-13T17:02:17.069 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.103 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.042) 0:01:42.490 ***** 2021-02-13T17:02:17.109 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-13T17:02:17.110 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.151 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.048) 0:01:42.538 ***** 2021-02-13T17:02:17.158 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-13T17:02:17.159 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.195 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.043) 0:01:42.582 ***** 2021-02-13T17:02:17.202 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-13T17:02:17.203 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.240 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.044) 0:01:42.626 ***** 2021-02-13T17:02:17.247 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-13T17:02:17.248 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.284 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.044) 0:01:42.671 ***** 2021-02-13T17:02:17.290 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:02:17.291 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.328 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.043) 0:01:42.714 ***** 2021-02-13T17:02:17.334 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-13T17:02:17.335 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.371 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.043) 0:01:42.758 ***** 2021-02-13T17:02:17.377 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-13T17:02:17.378 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.426 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.054) 0:01:42.812 ***** 2021-02-13T17:02:17.432 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-13T17:02:17.433 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.468 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.042) 0:01:42.855 ***** 2021-02-13T17:02:17.476 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-13T17:02:17.477 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.517 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.048) 0:01:42.904 ***** 2021-02-13T17:02:17.524 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-13T17:02:17.526 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.576 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.058) 0:01:42.963 ***** 2021-02-13T17:02:17.583 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-13T17:02:17.585 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.636 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.059) 0:01:43.022 ***** 2021-02-13T17:02:17.643 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-13T17:02:17.644 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.686 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.050) 0:01:43.072 ***** 2021-02-13T17:02:17.692 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-13T17:02:17.694 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.735 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.049) 0:01:43.122 ***** 2021-02-13T17:02:17.741 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-13T17:02:17.743 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.777 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.042) 0:01:43.164 ***** 2021-02-13T17:02:17.785 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-13T17:02:17.786 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.824 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.046) 0:01:43.210 ***** 2021-02-13T17:02:17.833 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-13T17:02:17.833 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.874 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.050) 0:01:43.261 ***** 2021-02-13T17:02:17.880 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-13T17:02:17.882 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.918 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.044) 0:01:43.305 ***** 2021-02-13T17:02:17.926 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-13T17:02:17.927 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:17.962 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.043) 0:01:43.349 ***** 2021-02-13T17:02:17.968 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-13T17:02:17.968 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:18.005 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:17 +0000 (0:00:00.042) 0:01:43.392 ***** 2021-02-13T17:02:18.011 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-13T17:02:18.011 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:18.054 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:18 +0000 (0:00:00.049) 0:01:43.441 ***** 2021-02-13T17:02:18.060 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-13T17:02:18.061 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:18.097 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:18 +0000 (0:00:00.042) 0:01:43.484 ***** 2021-02-13T17:02:18.103 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:18.140 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:18 +0000 (0:00:00.042) 0:01:43.526 ***** 2021-02-13T17:02:18.145 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-13T17:02:18.147 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:18.184 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:18 +0000 (0:00:00.044) 0:01:43.571 ***** 2021-02-13T17:02:18.191 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-13T17:02:18.193 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:18.226 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:18 +0000 (0:00:00.042) 0:01:43.613 ***** 2021-02-13T17:02:18.232 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-13T17:02:18.233 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:18.269 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:18 +0000 (0:00:00.042) 0:01:43.656 ***** 2021-02-13T17:02:18.275 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-13T17:02:18.277 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:18.313 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:18 +0000 (0:00:00.044) 0:01:43.700 ***** 2021-02-13T17:02:18.320 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-13T17:02:18.321 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:18.358 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:18 +0000 (0:00:00.044) 0:01:43.745 ***** 2021-02-13T17:02:18.364 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-13T17:02:18.365 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:18.401 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:18 +0000 (0:00:00.042) 0:01:43.788 ***** 2021-02-13T17:02:18.407 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-13T17:02:18.408 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:18.449 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:18 +0000 (0:00:00.048) 0:01:43.836 ***** 2021-02-13T17:02:18.457 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-02-13T17:02:18.458 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:18.493 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:18 +0000 (0:00:00.043) 0:01:43.879 ***** 2021-02-13T17:02:18.499 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-13T17:02:18.499 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:18.538 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:18 +0000 (0:00:00.044) 0:01:43.924 ***** 2021-02-13T17:02:18.565 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-13T17:02:18.566 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:18.601 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:18 +0000 (0:00:00.063) 0:01:43.988 ***** 2021-02-13T17:02:18.607 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-02-13T17:02:18.607 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-02-13T17:02:18.653 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:18 +0000 (0:00:00.051) 0:01:44.039 ***** 2021-02-13T17:02:18.660 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-13T17:02:18.661 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:18.707 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:18 +0000 (0:00:00.053) 0:01:44.093 ***** 2021-02-13T17:02:18.737 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-13T17:02:18.739 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:18.778 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:18 +0000 (0:00:00.070) 0:01:44.164 ***** 2021-02-13T17:02:18.805 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-02-13T17:02:18.806 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:18.847 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:18 +0000 (0:00:00.069) 0:01:44.234 ***** 2021-02-13T17:02:18.877 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-13T17:02:18.878 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-02-13T17:02:18.915 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:18 +0000 (0:00:00.067) 0:01:44.302 ***** 2021-02-13T17:02:18.943 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-13T17:02:18.945 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-02-13T17:02:18.980 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:18 +0000 (0:00:00.065) 0:01:44.367 ***** 2021-02-13T17:02:19.020 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:19 +0000 (0:00:00.038) 0:01:44.406 ***** 2021-02-13T17:02:19.197 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-13T17:02:19.198 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-02-13T17:02:19.242 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:19 +0000 (0:00:00.221) 0:01:44.628 ***** 2021-02-13T17:02:19.281 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-13T17:02:19.282 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-02-13T17:02:19.283 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-02-13T17:02:19.322 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:19 +0000 (0:00:00.080) 0:01:44.709 ***** 2021-02-13T17:02:19.357 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:19 +0000 (0:00:00.034) 0:01:44.743 ***** 2021-02-13T17:02:19.580 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-02-13T17:02:19.627 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:19 +0000 (0:00:00.270) 0:01:45.014 ***** 2021-02-13T17:02:19.633 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-02-13T17:02:19.634 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-02-13T17:02:19.673 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:19 +0000 (0:00:00.046) 0:01:45.060 ***** 2021-02-13T17:02:19.870 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-02-13T17:02:19.909 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:19 +0000 (0:00:00.235) 0:01:45.296 ***** 2021-02-13T17:02:19.927 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-02-13T17:02:19.929 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-02-13T17:02:19.968 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:19 +0000 (0:00:00.059) 0:01:45.355 ***** 2021-02-13T17:02:20.070 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-02-13T17:02:20.071 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-13T17:02:20.107 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:20 +0000 (0:00:00.137) 0:01:45.493 ***** 2021-02-13T17:02:20.133 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-02-13T17:02:20.135 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.169 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:20 +0000 (0:00:00.062) 0:01:45.556 ***** 2021-02-13T17:02:20.175 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-02-13T17:02:20.176 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-02-13T17:02:20.212 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:20 +0000 (0:00:00.043) 0:01:45.599 ***** 2021-02-13T17:02:20.218 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-02-13T17:02:20.220 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.257 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:20 +0000 (0:00:00.044) 0:01:45.644 ***** 2021-02-13T17:02:20.284 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-02-13T17:02:20.286 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.321 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:20 +0000 (0:00:00.063) 0:01:45.707 ***** 2021-02-13T17:02:20.327 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-02-13T17:02:20.327 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-13T17:02:20.365 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:20 +0000 (0:00:00.043) 0:01:45.751 ***** 2021-02-13T17:02:20.371 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-02-13T17:02:20.372 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.410 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:20 +0000 (0:00:00.044) 0:01:45.796 ***** 2021-02-13T17:02:20.416 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-02-13T17:02:20.416 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.455 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:20 +0000 (0:00:00.045) 0:01:45.841 ***** 2021-02-13T17:02:20.462 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-02-13T17:02:20.463 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.498 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:20 +0000 (0:00:00.043) 0:01:45.885 ***** 2021-02-13T17:02:20.506 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.544 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:20 +0000 (0:00:00.046) 0:01:45.931 ***** 2021-02-13T17:02:20.552 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:02:20.552 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-02-13T17:02:20.595 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:20 +0000 (0:00:00.050) 0:01:45.982 ***** 2021-02-13T17:02:20.603 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-02-13T17:02:20.603 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.642 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:20 +0000 (0:00:00.047) 0:01:46.029 ***** 2021-02-13T17:02:20.650 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-02-13T17:02:20.652 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.662 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.663 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.699 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:20 +0000 (0:00:00.057) 0:01:46.086 ***** 2021-02-13T17:02:20.706 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-02-13T17:02:20.708 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.709 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [gibba038.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.720 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.720 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.722 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.758 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:20 +0000 (0:00:00.058) 0:01:46.145 ***** 2021-02-13T17:02:20.764 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-02-13T17:02:20.765 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.767 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.811 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:20 +0000 (0:00:00.052) 0:01:46.197 ***** 2021-02-13T17:02:20.818 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:02:20.819 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-02-13T17:02:20.860 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:20 +0000 (0:00:00.049) 0:01:46.246 ***** 2021-02-13T17:02:20.910 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-02-13T17:02:20.911 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.921 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.922 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.933 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.944 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.955 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.966 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-02-13T17:02:20.977 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.988 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.989 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:20.990 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:21.000 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:21.011 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:21.011 INFO:teuthology.task.ansible.out: 2021-02-13T17:02:21.022 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-02-13T17:02:21.024 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.002877", "end": "2021-02-13 17:02:20.994325", "rc": 0, "start": "2021-02-13 17:02:20.991448", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/bin/teuthology-lock"]} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba037.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:21.066 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:21 +0000 (0:00:00.206) 0:01:46.453 ***** 2021-02-13T17:02:21.107 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:21 +0000 (0:00:00.040) 0:01:46.493 ***** 2021-02-13T17:02:21.146 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-02-13T17:02:21.147 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:21.186 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:21 +0000 (0:00:00.079) 0:01:46.573 ***** 2021-02-13T17:02:21.217 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-02-13T17:02:21.218 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:21.255 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:21 +0000 (0:00:00.068) 0:01:46.642 ***** 2021-02-13T17:02:21.256 INFO:teuthology.task.ansible.out: 2021-02-13T17:02:21.273 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-02-13T17:02:21.274 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004448", "end": "2021-02-13 17:02:21.243379", "rc": 0, "start": "2021-02-13 17:02:21.238931", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/bin/teuthology-lock"]} 2021-02-13T17:02:21.321 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:21 +0000 (0:00:00.065) 0:01:46.708 ***** 2021-02-13T17:02:21.328 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-02-13T17:02:21.329 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:21.367 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:21 +0000 (0:00:00.046) 0:01:46.754 ***** 2021-02-13T17:02:21.375 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-02-13T17:02:21.376 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:21.419 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:21 +0000 (0:00:00.051) 0:01:46.806 ***** 2021-02-13T17:02:21.456 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-02-13T17:02:21.458 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:21.496 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:21 +0000 (0:00:00.077) 0:01:46.883 ***** 2021-02-13T17:02:21.523 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-02-13T17:02:21.524 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:21.562 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:21 +0000 (0:00:00.065) 0:01:46.948 ***** 2021-02-13T17:02:21.956 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-02-13T17:02:21.958 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1613235472, "cache_updated": false, "changed": false} 2021-02-13T17:02:21.994 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:21 +0000 (0:00:00.431) 0:01:47.380 ***** 2021-02-13T17:02:22.020 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-02-13T17:02:22.021 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:22.057 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:22 +0000 (0:00:00.063) 0:01:47.444 ***** 2021-02-13T17:02:22.095 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-13T17:02:22.096 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'block_used': 13757939, 'uuid': '544fff2a-e246-4637-96d0-94b4cd4bcfea', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226337169, 'size_available': 927077044224, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149516, 'block_size': 4096, 'inode_available': 60905460}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226337169, "block_size": 4096, "block_total": 240095108, "block_used": 13757939, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905460, "inode_total": 61054976, "inode_used": 149516, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927077044224, "size_total": 983429562368, "uuid": "544fff2a-e246-4637-96d0-94b4cd4bcfea"}} 2021-02-13T17:02:22.133 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:22 +0000 (0:00:00.075) 0:01:47.519 ***** 2021-02-13T17:02:22.151 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-02-13T17:02:22.153 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1613235443, "cache_updated": false, "changed": false} 2021-02-13T17:02:22.191 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:22 +0000 (0:00:00.058) 0:01:47.578 ***** 2021-02-13T17:02:22.220 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-02-13T17:02:22.221 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:22.257 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:22 +0000 (0:00:00.065) 0:01:47.644 ***** 2021-02-13T17:02:22.264 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-02-13T17:02:22.264 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002506", "end": "2021-02-13 17:02:22.096344", "rc": 0, "start": "2021-02-13 17:02:22.093838", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:22.306 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:22 +0000 (0:00:00.048) 0:01:47.693 ***** 2021-02-13T17:02:22.314 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-13T17:02:22.316 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item={'block_used': 13757939, 'uuid': '544fff2a-e246-4637-96d0-94b4cd4bcfea', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226337169, 'size_available': 927077044224, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149516, 'block_size': 4096, 'inode_available': 60905460}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226337169, "block_size": 4096, "block_total": 240095108, "block_used": 13757939, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905460, "inode_total": 61054976, "inode_used": 149516, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927077044224, "size_total": 983429562368, "uuid": "544fff2a-e246-4637-96d0-94b4cd4bcfea"}} 2021-02-13T17:02:22.366 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:22 +0000 (0:00:00.060) 0:01:47.753 ***** 2021-02-13T17:02:22.373 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-02-13T17:02:22.374 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'block_used': 13757939, 'uuid': '544fff2a-e246-4637-96d0-94b4cd4bcfea', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226337169, 'size_available': 927077044224, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149516, 'block_size': 4096, 'inode_available': 60905460}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226337169, "block_size": 4096, "block_total": 240095108, "block_used": 13757939, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905460, "inode_total": 61054976, "inode_used": 149516, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927077044224, "size_total": 983429562368, "uuid": "544fff2a-e246-4637-96d0-94b4cd4bcfea"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:22.423 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:22 +0000 (0:00:00.056) 0:01:47.809 ***** 2021-02-13T17:02:22.451 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-02-13T17:02:22.487 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:22 +0000 (0:00:00.064) 0:01:47.874 ***** 2021-02-13T17:02:22.495 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-02-13T17:02:22.495 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002461", "end": "2021-02-13 17:02:22.450184", "rc": 0, "start": "2021-02-13 17:02:22.447723", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:22.534 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:22 +0000 (0:00:00.046) 0:01:47.921 ***** 2021-02-13T17:02:22.541 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-13T17:02:22.542 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:22.574 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-02-13T17:02:22.576 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'block_used': 13757939, 'uuid': '544fff2a-e246-4637-96d0-94b4cd4bcfea', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226337169, 'size_available': 927077044224, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149516, 'block_size': 4096, 'inode_available': 60905460}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226337169, "block_size": 4096, "block_total": 240095108, "block_used": 13757939, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905460, "inode_total": 61054976, "inode_used": 149516, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927077044224, "size_total": 983429562368, "uuid": "544fff2a-e246-4637-96d0-94b4cd4bcfea"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:22.612 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:22 +0000 (0:00:00.077) 0:01:47.998 ***** 2021-02-13T17:02:22.639 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-02-13T17:02:22.676 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:22 +0000 (0:00:00.063) 0:01:48.063 ***** 2021-02-13T17:02:22.724 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-13T17:02:22.725 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:24.445 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-S4cpOwjo9ovZ2He2G8A3ZnpQklAg0Slp7zHA1ZZYHl66NQPYEBCrjNdikXYSw8Md'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.586977", "end": "2021-02-13 17:02:24.420769", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-S4cpOwjo9ovZ2He2G8A3ZnpQklAg0Slp7zHA1ZZYHl66NQPYEBCrjNdikXYSw8Md"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:22.833792", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:02:24.457 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:24.469 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:24.491 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-gU0Sj3Z2OrzSSYpzZUL7ReW6tXCtCuH3D6LAsXqOtGb0VbM7IyGI1BjPfjq92o1C'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.863688", "end": "2021-02-13 17:02:24.346017", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-gU0Sj3Z2OrzSSYpzZUL7ReW6tXCtCuH3D6LAsXqOtGb0VbM7IyGI1BjPfjq92o1C"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:22.482329", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:02:24.503 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:24.503 INFO:teuthology.task.ansible.out: 2021-02-13T17:02:24.515 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:25.637 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-S4cpOwjo9ovZ2He2G8A3ZnpQklAg0SlpalMa8JsSAxtHgQjYuVrJSKauoyPnLHCO'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.086651", "end": "2021-02-13 17:02:25.615186", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-S4cpOwjo9ovZ2He2G8A3ZnpQklAg0SlpalMa8JsSAxtHgQjYuVrJSKauoyPnLHCO"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:24.528535", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:02:25.649 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2L2F6XF', 'wwn-0x50000399ab9813f4'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '544fff2a-e246-4637-96d0-94b4cd4bcfea', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2L2F6XF-part1', 'wwn-0x50000399ab9813f4-part1'], 'uuids': ['544fff2a-e246-4637-96d0-94b4cd4bcfea']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813f4', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2L2F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2L2F6XF", "wwn-0x50000399ab9813f4"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2L2F6XF-part1", "wwn-0x50000399ab9813f4-part1"], "labels": [], "masters": [], "uuids": ["544fff2a-e246-4637-96d0-94b4cd4bcfea"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "544fff2a-e246-4637-96d0-94b4cd4bcfea"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2L2F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813f4"}}, "skip_reason": "Conditional result w 2021-02-13T17:02:25.650 INFO:teuthology.task.ansible.out:as False"} 2021-02-13T17:02:25.683 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-gU0Sj3Z2OrzSSYpzZUL7ReW6tXCtCuH37iHm0QoO25ys3eiYWKvu1bn5eXey8Dpo'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.081770", "end": "2021-02-13 17:02:25.540903", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-gU0Sj3Z2OrzSSYpzZUL7ReW6tXCtCuH37iHm0QoO25ys3eiYWKvu1bn5eXey8Dpo"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:24.459133", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:02:25.695 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF', 'wwn-0x50000399ab801e94'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '544fff2a-e246-4637-96d0-94b4cd4bcfea', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF-part1', 'wwn-0x50000399ab801e94-part1'], 'uuids': ['544fff2a-e246-4637-96d0-94b4cd4bcfea']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab801e94', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I3K3Q0F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF", "wwn-0x50000399ab801e94"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF-part1", "wwn-0x50000399ab801e94-part1"], "labels": [], "masters": [], "uuids": ["544fff2a-e246-4637-96d0-94b4cd4bcfea"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "544fff2a-e246-4637-96d0-94b4cd4bcfea"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I3K3Q0F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab801e94"}}, "skip_reason": "Conditional result w 2021-02-13T17:02:25.697 INFO:teuthology.task.ansible.out:as False"} 2021-02-13T17:02:26.874 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-5v9N5e-cTzs-0FMr-peMF-g53N-YwY7-r1Vza2', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400D3375A', 'nvme-nvme.8086-50484b4d393133343030443333373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane DC P4800X Series SSD', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.135761", "end": "2021-02-13 17:02:26.849392", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane DC P4800X Series SSD", "links": {"ids": ["lvm-pv-uuid-5v9N5e-cTzs-0FMr-peMF-g53N-YwY7-r1Vza2", "nvme-INTEL_SSDPEL1K375GA_PHKM913400D3375A", "nvme-nvme.8086-50484b4d393133343030443333373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:25.713631", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now parti 2021-02-13T17:02:26.876 INFO:teuthology.task.ansible.out:tion the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:02:26.887 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:26.899 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:26.921 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-KZnHYU-kNJz-zWr6-fWdG-JLuQ-s8z9-loiTeD', 'nvme-INTEL_SSDPEL1K375GA_PHKM920000A4375A', 'nvme-nvme.8086-50484b4d393230303030413433373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane DC P4800X Series SSD', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.127286", "end": "2021-02-13 17:02:26.780386", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane DC P4800X Series SSD", "links": {"ids": ["lvm-pv-uuid-KZnHYU-kNJz-zWr6-fWdG-JLuQ-s8z9-loiTeD", "nvme-INTEL_SSDPEL1K375GA_PHKM920000A4375A", "nvme-nvme.8086-50484b4d393230303030413433373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:25.653100", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now parti 2021-02-13T17:02:26.923 INFO:teuthology.task.ansible.out:tion the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:02:26.933 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:26.944 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:28.083 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-S4cpOwjo9ovZ2He2G8A3ZnpQklAg0SlpS79Zw8ai93yLWzT2Z9gErbuuGY5QwiRa'], 'uuids': ['09167914-299f-4558-bea3-7cea29757bae']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.094513", "end": "2021-02-13 17:02:28.057665", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-S4cpOwjo9ovZ2He2G8A3ZnpQklAg0SlpS79Zw8ai93yLWzT2Z9gErbuuGY5QwiRa"], "labels": [], "masters": [], "uuids": ["09167914-299f-4558-bea3-7cea29757bae"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:26.963152", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:02:28.094 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:28.105 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:28.128 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-gU0Sj3Z2OrzSSYpzZUL7ReW6tXCtCuH3pKevF0eElGBimR416ZQBOHEhJ6sm4yDx'], 'uuids': ['c91f489d-b656-44b0-8a22-5c5b9af52962']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.097501", "end": "2021-02-13 17:02:27.984310", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-gU0Sj3Z2OrzSSYpzZUL7ReW6tXCtCuH3pKevF0eElGBimR416ZQBOHEhJ6sm4yDx"], "labels": [], "masters": [], "uuids": ["c91f489d-b656-44b0-8a22-5c5b9af52962"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:26.886809", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:02:28.140 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:28.151 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:29.285 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-S4cpOwjo9ovZ2He2G8A3ZnpQklAg0Slpg5qYUXN2e2V2kg24JQqwxBgXTmdC2dMS'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.096403", "end": "2021-02-13 17:02:29.257546", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-S4cpOwjo9ovZ2He2G8A3ZnpQklAg0Slpg5qYUXN2e2V2kg24JQqwxBgXTmdC2dMS"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:28.161143", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:02:29.297 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:29.340 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-gU0Sj3Z2OrzSSYpzZUL7ReW6tXCtCuH39uLR94EJdjbXUnrQzOtUOSVOvqRvddhh'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.088414", "end": "2021-02-13 17:02:29.193209", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-gU0Sj3Z2OrzSSYpzZUL7ReW6tXCtCuH39uLR94EJdjbXUnrQzOtUOSVOvqRvddhh"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:28.104795", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:02:29.351 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:30.481 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-S4cpOwjo9ovZ2He2G8A3ZnpQklAg0SlpLBF7Vb224k0VIBAZ79wmwi5LHHLTu383'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.096684", "end": "2021-02-13 17:02:30.449184", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-S4cpOwjo9ovZ2He2G8A3ZnpQklAg0SlpLBF7Vb224k0VIBAZ79wmwi5LHHLTu383"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:29.352500", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:02:30.532 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:30 +0000 (0:00:07.856) 0:01:55.919 ***** 2021-02-13T17:02:30.542 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-gU0Sj3Z2OrzSSYpzZUL7ReW6tXCtCuH3pfEj0mFe2j8G7kJ4kKJfzmYFxPOQWkLU'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.104129", "end": "2021-02-13 17:02:30.395094", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-gU0Sj3Z2OrzSSYpzZUL7ReW6tXCtCuH3pfEj0mFe2j8G7kJ4kKJfzmYFxPOQWkLU"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:29.290965", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:02:30.592 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:30 +0000 (0:00:00.059) 0:01:55.979 ***** 2021-02-13T17:02:30.599 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-13T17:02:30.599 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:30.634 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:30.741 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-S4cpOwjo9ovZ2He2G8A3ZnpQklAg0Slp7zHA1ZZYHl66NQPYEBCrjNdikXYSw8Md'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.075594", "end": "2021-02-13 17:02:30.715587", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-S4cpOwjo9ovZ2He2G8A3ZnpQklAg0Slp7zHA1ZZYHl66NQPYEBCrjNdikXYSw8Md"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:30.639993", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0744403 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0744403 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:30.752 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:30.775 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:30.797 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-gU0Sj3Z2OrzSSYpzZUL7ReW6tXCtCuH3D6LAsXqOtGb0VbM7IyGI1BjPfjq92o1C'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.075825", "end": "2021-02-13 17:02:30.661229", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-gU0Sj3Z2OrzSSYpzZUL7ReW6tXCtCuH3D6LAsXqOtGb0VbM7IyGI1BjPfjq92o1C"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:30.585404", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0746107 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0746107 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:30.809 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:30.820 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:30.937 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-S4cpOwjo9ovZ2He2G8A3ZnpQklAg0SlpalMa8JsSAxtHgQjYuVrJSKauoyPnLHCO'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.080071", "end": "2021-02-13 17:02:30.914050", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-S4cpOwjo9ovZ2He2G8A3ZnpQklAg0SlpalMa8JsSAxtHgQjYuVrJSKauoyPnLHCO"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:30.833979", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0789271 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0789271 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:30.949 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2L2F6XF', 'wwn-0x50000399ab9813f4'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '544fff2a-e246-4637-96d0-94b4cd4bcfea', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2L2F6XF-part1', 'wwn-0x50000399ab9813f4-part1'], 'uuids': ['544fff2a-e246-4637-96d0-94b4cd4bcfea']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813f4', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2L2F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2L2F6XF", "wwn-0x50000399ab9813f4"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2L2F6XF-part1", "wwn-0x50000399ab9813f4-part1"], "labels": [], "masters": [], "uuids": ["544fff2a-e246-4637-96d0-94b4cd4bcfea"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "544fff2a-e246-4637-96d0-94b4cd4bcfea"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2L2F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813f4"}}, "skip_reason": "Conditional result w 2021-02-13T17:02:30.950 INFO:teuthology.task.ansible.out:as False"} 2021-02-13T17:02:30.982 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-gU0Sj3Z2OrzSSYpzZUL7ReW6tXCtCuH37iHm0QoO25ys3eiYWKvu1bn5eXey8Dpo'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.076085", "end": "2021-02-13 17:02:30.841559", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-gU0Sj3Z2OrzSSYpzZUL7ReW6tXCtCuH37iHm0QoO25ys3eiYWKvu1bn5eXey8Dpo"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:30.765474", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0748635 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0748635 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:30.994 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF', 'wwn-0x50000399ab801e94'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '544fff2a-e246-4637-96d0-94b4cd4bcfea', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF-part1', 'wwn-0x50000399ab801e94-part1'], 'uuids': ['544fff2a-e246-4637-96d0-94b4cd4bcfea']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab801e94', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I3K3Q0F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF", "wwn-0x50000399ab801e94"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF-part1", "wwn-0x50000399ab801e94-part1"], "labels": [], "masters": [], "uuids": ["544fff2a-e246-4637-96d0-94b4cd4bcfea"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "544fff2a-e246-4637-96d0-94b4cd4bcfea"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I3K3Q0F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab801e94"}}, "skip_reason": "Conditional result w 2021-02-13T17:02:30.995 INFO:teuthology.task.ansible.out:as False"} 2021-02-13T17:02:31.048 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-5v9N5e-cTzs-0FMr-peMF-g53N-YwY7-r1Vza2', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400D3375A', 'nvme-nvme.8086-50484b4d393133343030443333373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane DC P4800X Series SSD', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.023638", "end": "2021-02-13 17:02:31.022332", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane DC P4800X Series SSD", "links": {"ids": ["lvm-pv-uuid-5v9N5e-cTzs-0FMr-peMF-g53N-YwY7-r1Vza2", "nvme-INTEL_SSDPEL1K375GA_PHKM913400D3375A", "nvme-nvme.8086-50484b4d393133343030443333373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:30.998694", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0223682 s, 5.2 GB/s", "stderr_lines": ["110 2021-02-13T17:02:31.049 INFO:teuthology.task.ansible.out:+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0223682 s, 5.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:31.060 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:31.071 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:31.167 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-KZnHYU-kNJz-zWr6-fWdG-JLuQ-s8z9-loiTeD', 'nvme-INTEL_SSDPEL1K375GA_PHKM920000A4375A', 'nvme-nvme.8086-50484b4d393230303030413433373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane DC P4800X Series SSD', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.023506", "end": "2021-02-13 17:02:31.023431", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane DC P4800X Series SSD", "links": {"ids": ["lvm-pv-uuid-KZnHYU-kNJz-zWr6-fWdG-JLuQ-s8z9-loiTeD", "nvme-INTEL_SSDPEL1K375GA_PHKM920000A4375A", "nvme-nvme.8086-50484b4d393230303030413433373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:30.999925", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0223419 s, 5.2 GB/s", "stderr_lines": ["110 2021-02-13T17:02:31.169 INFO:teuthology.task.ansible.out:+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0223419 s, 5.2 GB/s"], "stdout": "", "stdout_lines": []} skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:31.180 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:31.223 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-S4cpOwjo9ovZ2He2G8A3ZnpQklAg0SlpS79Zw8ai93yLWzT2Z9gErbuuGY5QwiRa'], 'uuids': ['09167914-299f-4558-bea3-7cea29757bae']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.076278", "end": "2021-02-13 17:02:31.196864", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-S4cpOwjo9ovZ2He2G8A3ZnpQklAg0SlpS79Zw8ai93yLWzT2Z9gErbuuGY5QwiRa"], "labels": [], "masters": [], "uuids": ["09167914-299f-4558-bea3-7cea29757bae"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:31.120586", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.075153 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.075153 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:31.235 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:31.257 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:31.344 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-gU0Sj3Z2OrzSSYpzZUL7ReW6tXCtCuH3pKevF0eElGBimR416ZQBOHEhJ6sm4yDx'], 'uuids': ['c91f489d-b656-44b0-8a22-5c5b9af52962']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.076320", "end": "2021-02-13 17:02:31.201617", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-gU0Sj3Z2OrzSSYpzZUL7ReW6tXCtCuH3pKevF0eElGBimR416ZQBOHEhJ6sm4yDx"], "labels": [], "masters": [], "uuids": ["c91f489d-b656-44b0-8a22-5c5b9af52962"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:31.125297", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0752401 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0752401 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:31.357 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:31.358 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:31.467 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-S4cpOwjo9ovZ2He2G8A3ZnpQklAg0Slpg5qYUXN2e2V2kg24JQqwxBgXTmdC2dMS'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.076055", "end": "2021-02-13 17:02:31.449073", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-S4cpOwjo9ovZ2He2G8A3ZnpQklAg0Slpg5qYUXN2e2V2kg24JQqwxBgXTmdC2dMS"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:31.373018", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0749718 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0749718 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:31.479 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:31.525 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-gU0Sj3Z2OrzSSYpzZUL7ReW6tXCtCuH39uLR94EJdjbXUnrQzOtUOSVOvqRvddhh'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.075938", "end": "2021-02-13 17:02:31.384142", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-gU0Sj3Z2OrzSSYpzZUL7ReW6tXCtCuH39uLR94EJdjbXUnrQzOtUOSVOvqRvddhh"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:31.308204", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.074842 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.074842 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:31.538 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:31.655 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-S4cpOwjo9ovZ2He2G8A3ZnpQklAg0SlpLBF7Vb224k0VIBAZ79wmwi5LHHLTu383'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.076461", "end": "2021-02-13 17:02:31.631941", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-S4cpOwjo9ovZ2He2G8A3ZnpQklAg0SlpLBF7Vb224k0VIBAZ79wmwi5LHHLTu383"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:31.555480", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0752609 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0752609 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:31.701 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:31 +0000 (0:00:01.109) 0:01:57.088 ***** 2021-02-13T17:02:31.712 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-gU0Sj3Z2OrzSSYpzZUL7ReW6tXCtCuH3pfEj0mFe2j8G7kJ4kKJfzmYFxPOQWkLU'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.075586", "end": "2021-02-13 17:02:31.567372", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-gU0Sj3Z2OrzSSYpzZUL7ReW6tXCtCuH3pfEj0mFe2j8G7kJ4kKJfzmYFxPOQWkLU"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:02:31.491786", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0744041 s, 1.6 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0744041 s, 1.6 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:31.766 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:31 +0000 (0:00:00.064) 0:01:57.152 ***** 2021-02-13T17:02:32.001 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-02-13T17:02:32.003 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.177714", "end": "2021-02-13 17:02:31.961043", "rc": 0, "start": "2021-02-13 17:02:31.783329", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:32.039 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:32 +0000 (0:00:00.273) 0:01:57.426 ***** 2021-02-13T17:02:32.048 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.134432", "end": "2021-02-13 17:02:31.864047", "rc": 0, "start": "2021-02-13 17:02:31.729615", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:32.088 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:32 +0000 (0:00:00.048) 0:01:57.475 ***** 2021-02-13T17:02:32.212 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-02-13T17:02:32.214 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.053227", "end": "2021-02-13 17:02:32.174466", "rc": 0, "start": "2021-02-13 17:02:32.121239", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:32.258 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:32 +0000 (0:00:00.169) 0:01:57.645 ***** 2021-02-13T17:02:32.266 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.051830", "end": "2021-02-13 17:02:32.108502", "rc": 0, "start": "2021-02-13 17:02:32.056672", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:32.304 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:32 +0000 (0:00:00.046) 0:01:57.691 ***** 2021-02-13T17:02:32.311 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-02-13T17:02:32.352 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:32 +0000 (0:00:00.047) 0:01:57.739 ***** 2021-02-13T17:02:32.399 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:32 +0000 (0:00:00.046) 0:01:57.786 ***** 2021-02-13T17:02:32.405 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-02-13T17:02:32.407 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:32.449 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:32 +0000 (0:00:00.050) 0:01:57.836 ***** 2021-02-13T17:02:32.456 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:32.498 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:32 +0000 (0:00:00.049) 0:01:57.885 ***** 2021-02-13T17:02:32.505 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-02-13T17:02:32.506 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:32.542 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:32 +0000 (0:00:00.043) 0:01:57.929 ***** 2021-02-13T17:02:32.549 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:32.598 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:32 +0000 (0:00:00.056) 0:01:57.985 ***** 2021-02-13T17:02:32.617 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-13T17:02:32.619 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:32.656 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:32 +0000 (0:00:00.058) 0:01:58.043 ***** 2021-02-13T17:02:32.663 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:32.702 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:32 +0000 (0:00:00.045) 0:01:58.089 ***** 2021-02-13T17:02:32.708 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:32.746 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:32 +0000 (0:00:00.043) 0:01:58.132 ***** 2021-02-13T17:02:32.753 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:32.791 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:32 +0000 (0:00:00.045) 0:01:58.178 ***** 2021-02-13T17:02:32.851 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-02-13T17:02:32.852 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-13T17:02:32.893 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:32 +0000 (0:00:00.101) 0:01:58.279 ***** 2021-02-13T17:02:32.900 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-13T17:02:32.947 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:32 +0000 (0:00:00.054) 0:01:58.334 ***** 2021-02-13T17:02:32.953 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-13T17:02:32.954 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'block_used': 13757939, 'uuid': '544fff2a-e246-4637-96d0-94b4cd4bcfea', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226337169, 'size_available': 927077044224, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149516, 'block_size': 4096, 'inode_available': 60905460}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226337169, "block_size": 4096, "block_total": 240095108, "block_used": 13757939, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905460, "inode_total": 61054976, "inode_used": 149516, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927077044224, "size_total": 983429562368, "uuid": "544fff2a-e246-4637-96d0-94b4cd4bcfea"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:32.996 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:32 +0000 (0:00:00.048) 0:01:58.382 ***** 2021-02-13T17:02:33.003 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'block_used': 13757939, 'uuid': '544fff2a-e246-4637-96d0-94b4cd4bcfea', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226337169, 'size_available': 927077044224, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149516, 'block_size': 4096, 'inode_available': 60905460}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226337169, "block_size": 4096, "block_total": 240095108, "block_used": 13757939, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905460, "inode_total": 61054976, "inode_used": 149516, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927077044224, "size_total": 983429562368, "uuid": "544fff2a-e246-4637-96d0-94b4cd4bcfea"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:33.042 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:33 +0000 (0:00:00.046) 0:01:58.429 ***** 2021-02-13T17:02:33.049 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-02-13T17:02:33.050 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:33.088 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:33 +0000 (0:00:00.046) 0:01:58.475 ***** 2021-02-13T17:02:33.096 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:33.137 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:33 +0000 (0:00:00.049) 0:01:58.524 ***** 2021-02-13T17:02:33.144 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:02:33.146 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:33.185 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:33 +0000 (0:00:00.047) 0:01:58.572 ***** 2021-02-13T17:02:33.307 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Saturday 13 February 2021 17:02:33 +0000 (0:00:00.047) 0:01:58.619 ***** TASK [testnode : set_fact] ***************************************************** skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Saturday 13 February 2021 17:02:33 +0000 (0:00:00.049) 0:01:58.669 ***** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:33.337 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:33 +0000 (0:00:00.054) 0:01:58.724 ***** 2021-02-13T17:02:33.346 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-02-13T17:02:33.346 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:33.388 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:33 +0000 (0:00:00.050) 0:01:58.775 ***** 2021-02-13T17:02:33.397 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:33.435 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:33 +0000 (0:00:00.046) 0:01:58.822 ***** 2021-02-13T17:02:33.441 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-02-13T17:02:33.442 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:33.480 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:33 +0000 (0:00:00.044) 0:01:58.866 ***** 2021-02-13T17:02:33.487 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:33.528 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:33 +0000 (0:00:00.048) 0:01:58.915 ***** 2021-02-13T17:02:33.534 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-02-13T17:02:33.535 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:33.571 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:33 +0000 (0:00:00.042) 0:01:58.958 ***** 2021-02-13T17:02:33.579 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:33.616 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:33 +0000 (0:00:00.045) 0:01:59.003 ***** 2021-02-13T17:02:34.264 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-02-13T17:02:34.265 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-02-13T17:02:34.301 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:34 +0000 (0:00:00.684) 0:01:59.688 ***** 2021-02-13T17:02:34.309 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-02-13T17:02:34.348 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:34 +0000 (0:00:00.046) 0:01:59.735 ***** 2021-02-13T17:02:34.752 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-13T17:02:34.754 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-13T17:02:34.796 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-13T17:02:34.913 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-13T17:02:34.987 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-13T17:02:35.072 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-13T17:02:35.198 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-13T17:02:35.272 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-13T17:02:35.356 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-13T17:02:35.441 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-13T17:02:35.482 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:35 +0000 (0:00:01.134) 0:02:00.869 ***** 2021-02-13T17:02:35.510 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-13T17:02:35.552 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:35 +0000 (0:00:00.070) 0:02:00.939 ***** 2021-02-13T17:02:35.553 INFO:teuthology.task.ansible.out: 2021-02-13T17:02:35.636 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-13T17:02:35.637 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-02-13T17:02:35.675 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:35 +0000 (0:00:00.122) 0:02:01.062 ***** 2021-02-13T17:02:35.703 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-02-13T17:02:35.743 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:35 +0000 (0:00:00.067) 0:02:01.129 ***** 2021-02-13T17:02:35.822 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-13T17:02:35.823 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-13T17:02:35.877 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-13T17:02:35.910 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-13T17:02:35.911 INFO:teuthology.task.ansible.out: 2021-02-13T17:02:35.964 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-13T17:02:35.976 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-13T17:02:36.040 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-13T17:02:36.063 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-13T17:02:36.075 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:36.117 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:36 +0000 (0:00:00.372) 0:02:01.502 ***** 2021-02-13T17:02:36.126 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-13T17:02:36.138 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:36.178 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:36 +0000 (0:00:00.063) 0:02:01.565 ***** 2021-02-13T17:02:36.184 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-02-13T17:02:36.186 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:36.224 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:36 +0000 (0:00:00.045) 0:02:01.611 ***** 2021-02-13T17:02:36.233 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:36.272 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:36 +0000 (0:00:00.047) 0:02:01.659 ***** 2021-02-13T17:02:36.279 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-02-13T17:02:36.280 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:36.317 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:36 +0000 (0:00:00.044) 0:02:01.704 ***** 2021-02-13T17:02:36.324 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:36.363 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:36 +0000 (0:00:00.045) 0:02:01.750 ***** 2021-02-13T17:02:36.364 INFO:teuthology.task.ansible.out: 2021-02-13T17:02:36.422 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-02-13T17:02:36.423 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-02-13T17:02:36.461 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:36 +0000 (0:00:00.098) 0:02:01.848 ***** 2021-02-13T17:02:36.479 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-02-13T17:02:36.520 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:36 +0000 (0:00:00.058) 0:02:01.907 ***** 2021-02-13T17:02:36.529 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-02-13T17:02:36.530 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-02-13T17:02:36.571 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:36 +0000 (0:00:00.050) 0:02:01.958 ***** 2021-02-13T17:02:36.578 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-02-13T17:02:36.617 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:36 +0000 (0:00:00.045) 0:02:02.003 ***** 2021-02-13T17:02:36.929 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-02-13T17:02:36.930 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true} 2021-02-13T17:02:36.974 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:36 +0000 (0:00:00.357) 0:02:02.361 ***** 2021-02-13T17:02:36.981 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true} 2021-02-13T17:02:37.025 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:37 +0000 (0:00:00.050) 0:02:02.411 ***** 2021-02-13T17:02:37.382 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-02-13T17:02:37.384 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-02-13T17:02:37.419 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:37 +0000 (0:00:00.394) 0:02:02.806 ***** 2021-02-13T17:02:37.425 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-02-13T17:02:37.467 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:37 +0000 (0:00:00.048) 0:02:02.854 ***** 2021-02-13T17:02:37.476 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-02-13T17:02:37.477 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:37.512 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:37 +0000 (0:00:00.044) 0:02:02.899 ***** 2021-02-13T17:02:37.520 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:37.557 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:37 +0000 (0:00:00.044) 0:02:02.944 ***** 2021-02-13T17:02:37.564 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:37.603 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:37 +0000 (0:00:00.045) 0:02:02.989 ***** 2021-02-13T17:02:37.610 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:37.648 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:37 +0000 (0:00:00.045) 0:02:03.035 ***** 2021-02-13T17:02:37.656 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:37.698 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:37 +0000 (0:00:00.049) 0:02:03.084 ***** 2021-02-13T17:02:37.704 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:37.740 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:37 +0000 (0:00:00.042) 0:02:03.127 ***** 2021-02-13T17:02:37.746 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-13T17:02:37.748 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:37.784 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:37 +0000 (0:00:00.043) 0:02:03.170 ***** 2021-02-13T17:02:37.790 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:37.829 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:37 +0000 (0:00:00.045) 0:02:03.215 ***** 2021-02-13T17:02:37.909 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-02-13T17:02:37.910 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-02-13T17:02:37.968 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:37 +0000 (0:00:00.139) 0:02:03.355 ***** 2021-02-13T17:02:37.977 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-02-13T17:02:38.018 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:38 +0000 (0:00:00.049) 0:02:03.405 ***** 2021-02-13T17:02:38.087 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-02-13T17:02:38.124 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:38 +0000 (0:00:00.106) 0:02:03.511 ***** 2021-02-13T17:02:38.131 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-02-13T17:02:38.168 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:38 +0000 (0:00:00.044) 0:02:03.555 ***** 2021-02-13T17:02:38.364 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-02-13T17:02:38.366 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1234, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-02-13T17:02:38.401 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:38 +0000 (0:00:00.232) 0:02:03.788 ***** 2021-02-13T17:02:38.417 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1234, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-02-13T17:02:38.455 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:38 +0000 (0:00:00.053) 0:02:03.841 ***** 2021-02-13T17:02:38.680 INFO:teuthology.task.ansible.out: 2021-02-13T17:02:38.682 INFO:teuthology.task.ansible.out:TASK [testnode : Upload CPAN config for root.] ********************************* ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-02-13T17:02:38.720 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:38 +0000 (0:00:00.265) 0:02:04.107 ***** 2021-02-13T17:02:38.738 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-02-13T17:02:38.776 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:38 +0000 (0:00:00.055) 0:02:04.163 ***** 2021-02-13T17:02:39.317 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1613235472, "cache_updated": false, "changed": false} 2021-02-13T17:02:39.375 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:39 +0000 (0:00:00.598) 0:02:04.762 ***** 2021-02-13T17:02:39.386 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1613235443, "cache_updated": false, "changed": false} 2021-02-13T17:02:39.448 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:39 +0000 (0:00:00.072) 0:02:04.834 ***** 2021-02-13T17:02:39.541 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-02-13T17:02:39.542 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.024850", "end": "2021-02-13 17:02:39.403913", "rc": 0, "start": "2021-02-13 17:02:39.379063", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2021-02-13T17:02:39.579 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:39 +0000 (0:00:00.131) 0:02:04.966 ***** 2021-02-13T17:02:39.597 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.024580", "end": "2021-02-13 17:02:39.580605", "rc": 0, "start": "2021-02-13 17:02:39.556025", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2021-02-13T17:02:39.650 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:39 +0000 (0:00:00.071) 0:02:05.037 ***** 2021-02-13T17:02:39.657 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-02-13T17:02:39.658 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:39.707 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:39 +0000 (0:00:00.056) 0:02:05.094 ***** 2021-02-13T17:02:39.715 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:39.763 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:39 +0000 (0:00:00.056) 0:02:05.150 ***** 2021-02-13T17:02:39.773 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-02-13T17:02:39.774 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:39.815 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:39 +0000 (0:00:00.051) 0:02:05.201 ***** 2021-02-13T17:02:39.821 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:39.859 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:39 +0000 (0:00:00.044) 0:02:05.245 ***** 2021-02-13T17:02:40.391 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-02-13T17:02:40.393 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1613235472, "cache_updated": false, "changed": false} 2021-02-13T17:02:40.429 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:40 +0000 (0:00:00.570) 0:02:05.816 ***** 2021-02-13T17:02:40.447 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1613235443, "cache_updated": false, "changed": false} 2021-02-13T17:02:40.483 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:40 +0000 (0:00:00.054) 0:02:05.870 ***** 2021-02-13T17:02:40.492 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-02-13T17:02:40.493 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:40.535 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:40 +0000 (0:00:00.051) 0:02:05.921 ***** 2021-02-13T17:02:40.542 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:40.583 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:40 +0000 (0:00:00.048) 0:02:05.970 ***** 2021-02-13T17:02:40.790 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-02-13T17:02:40.791 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-02-13T17:02:40.831 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:40 +0000 (0:00:00.247) 0:02:06.218 ***** 2021-02-13T17:02:40.838 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-02-13T17:02:40.877 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:40 +0000 (0:00:00.045) 0:02:06.263 ***** 2021-02-13T17:02:40.884 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-02-13T17:02:40.885 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:40.923 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:40 +0000 (0:00:00.046) 0:02:06.309 ***** 2021-02-13T17:02:40.929 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:40.980 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:40 +0000 (0:00:00.057) 0:02:06.367 ***** 2021-02-13T17:02:41.095 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-02-13T17:02:41.096 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2021-02-13 17:00:29 UTC", "ActiveEnterTimestampMonotonic": "24261168", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount sysinit.target network.target systemd-tmpfiles-setup.service basic.target systemd-journald.socket system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2021-02-13 17:00:23 UTC", "AssertTimestampMonotonic": "17668028", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2021-02-13 17:00:23 UTC", "ConditionTimestampMonotonic": "17668028", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Document 2021-02-13T17:02:41.097 INFO:teuthology.task.ansible.out:ation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2039", "ExecMainStartTimestamp": "Sat 2021-02-13 17:00:29 UTC", "ExecMainStartTimestampMonotonic": "24261129", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2021-02-13 17:00:23 UTC", "InactiveExitTimestampMonotonic": "17668462", "InvocationID": "5018e843046040a5a1dde9ad83bf1e72", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128079", "LimitNPROCSoft": "128079", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limit 2021-02-13T17:02:41.099 INFO:teuthology.task.ansible.out:RTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128079", "LimitSIGPENDINGSoft": "128079", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2039", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2021-02-13 17:00:29 UTC", "St 2021-02-13T17:02:41.100 INFO:teuthology.task.ansible.out:ateChangeTimestampMonotonic": "24261168", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2021-02-13 17:00:29 UTC", "WatchdogTimestampMonotonic": "24261166", "WatchdogUSec": "0"}} 2021-02-13T17:02:41.140 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:41 +0000 (0:00:00.159) 0:02:06.527 ***** 2021-02-13T17:02:41.149 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2021-02-13 17:00:25 UTC", "ActiveEnterTimestampMonotonic": "23678964", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount systemd-journald.socket system.slice systemd-tmpfiles-setup.service network.target sysinit.target basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2021-02-13 17:00:18 UTC", "AssertTimestampMonotonic": "17096406", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2021-02-13 17:00:18 UTC", "ConditionTimestampMonotonic": "17096406", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Document 2021-02-13T17:02:41.150 INFO:teuthology.task.ansible.out:ation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2026", "ExecMainStartTimestamp": "Sat 2021-02-13 17:00:25 UTC", "ExecMainStartTimestampMonotonic": "23678925", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2021-02-13 17:00:18 UTC", "InactiveExitTimestampMonotonic": "17096894", "InvocationID": "067e628e63464e199aa0b8683bc450b9", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128079", "LimitNPROCSoft": "128079", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limit 2021-02-13T17:02:41.151 INFO:teuthology.task.ansible.out:RTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128079", "LimitSIGPENDINGSoft": "128079", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2026", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2021-02-13 17:00:25 UTC", "St 2021-02-13T17:02:41.152 INFO:teuthology.task.ansible.out:ateChangeTimestampMonotonic": "23678964", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2021-02-13 17:00:25 UTC", "WatchdogTimestampMonotonic": "23678961", "WatchdogUSec": "0"}} 2021-02-13T17:02:41.187 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:41 +0000 (0:00:00.047) 0:02:06.574 ***** 2021-02-13T17:02:41.195 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:02:41.197 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-02-13T17:02:41.232 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:41 +0000 (0:00:00.044) 0:02:06.619 ***** 2021-02-13T17:02:41.238 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-02-13T17:02:41.276 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:41 +0000 (0:00:00.043) 0:02:06.663 ***** 2021-02-13T17:02:41.282 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:02:41.283 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:41.320 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:41 +0000 (0:00:00.044) 0:02:06.707 ***** 2021-02-13T17:02:41.326 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:41.370 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:41 +0000 (0:00:00.049) 0:02:06.756 ***** 2021-02-13T17:02:41.376 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-02-13T17:02:41.377 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:41.413 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:41 +0000 (0:00:00.042) 0:02:06.799 ***** 2021-02-13T17:02:41.419 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:41.457 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:41 +0000 (0:00:00.044) 0:02:06.843 ***** 2021-02-13T17:02:42.003 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-02-13T17:02:42.005 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1613235472, "cache_updated": false, "changed": false} 2021-02-13T17:02:42.052 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:42 +0000 (0:00:00.595) 0:02:07.439 ***** 2021-02-13T17:02:42.071 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1613235443, "cache_updated": false, "changed": false} 2021-02-13T17:02:42.120 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:42 +0000 (0:00:00.067) 0:02:07.507 ***** 2021-02-13T17:02:42.122 INFO:teuthology.task.ansible.out: 2021-02-13T17:02:42.132 INFO:teuthology.task.ansible.out: 2021-02-13T17:02:42.134 INFO:teuthology.task.ansible.out:TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:42.178 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:42 +0000 (0:00:00.057) 0:02:07.565 ***** 2021-02-13T17:02:42.179 INFO:teuthology.task.ansible.out: 2021-02-13T17:02:42.186 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:42.226 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:42 +0000 (0:00:00.048) 0:02:07.613 ***** 2021-02-13T17:02:42.299 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-02-13T17:02:42.337 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:42 +0000 (0:00:00.110) 0:02:07.724 ***** 2021-02-13T17:02:42.355 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-02-13T17:02:42.417 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:42 +0000 (0:00:00.079) 0:02:07.803 ***** 2021-02-13T17:02:42.607 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1234, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-02-13T17:02:42.607 INFO:teuthology.task.ansible.out: 2021-02-13T17:02:42.647 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:42 +0000 (0:00:00.229) 0:02:08.033 ***** 2021-02-13T17:02:42.689 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1234, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-02-13T17:02:42.730 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:42 +0000 (0:00:00.083) 0:02:08.117 ***** 2021-02-13T17:02:43.426 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-02-13T17:02:43.427 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-02-13T17:02:43.463 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:43 +0000 (0:00:00.732) 0:02:08.850 ***** 2021-02-13T17:02:43.502 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:43 +0000 (0:00:00.039) 0:02:08.889 ***** 2021-02-13T17:02:43.824 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-02-13T17:02:43.826 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false} 2021-02-13T17:02:43.861 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:43 +0000 (0:00:00.359) 0:02:09.248 ***** 2021-02-13T17:02:43.879 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false} 2021-02-13T17:02:43.916 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:43 +0000 (0:00:00.054) 0:02:09.303 ***** 2021-02-13T17:02:43.924 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-02-13T17:02:43.925 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-02-13T17:02:43.963 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:43 +0000 (0:00:00.046) 0:02:09.350 ***** 2021-02-13T17:02:43.972 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-02-13T17:02:44.011 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:44 +0000 (0:00:00.048) 0:02:09.398 ***** 2021-02-13T17:02:44.061 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-02-13T17:02:44.062 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1613235427.342607, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1613235427.338609, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 10060, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1613235427.338609, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3104356462", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-02-13T17:02:44.098 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:44 +0000 (0:00:00.086) 0:02:09.485 ***** 2021-02-13T17:02:44.116 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1613235426.6602075, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1613235426.6562095, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 10060, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1613235426.6562095, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3104356462", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-02-13T17:02:44.158 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:44 +0000 (0:00:00.059) 0:02:09.544 ***** 2021-02-13T17:02:44.447 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-02-13T17:02:44.449 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-02-13T17:02:44.495 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:44 +0000 (0:00:00.337) 0:02:09.882 ***** 2021-02-13T17:02:44.502 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-02-13T17:02:44.539 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:44 +0000 (0:00:00.043) 0:02:09.926 ***** 2021-02-13T17:02:44.546 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-02-13T17:02:44.547 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-02-13T17:02:44.583 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:44 +0000 (0:00:00.044) 0:02:09.970 ***** 2021-02-13T17:02:44.590 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-02-13T17:02:44.628 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:44 +0000 (0:00:00.044) 0:02:10.015 ***** 2021-02-13T17:02:44.634 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-02-13T17:02:44.635 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:44.678 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:44 +0000 (0:00:00.049) 0:02:10.065 ***** 2021-02-13T17:02:44.684 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:44.835 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:44 +0000 (0:00:00.157) 0:02:10.222 ***** 2021-02-13T17:02:44.842 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-02-13T17:02:44.843 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-02-13T17:02:44.880 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:44 +0000 (0:00:00.044) 0:02:10.267 ***** 2021-02-13T17:02:44.928 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-02-13T17:02:44.930 INFO:teuthology.task.ansible.out: 2021-02-13T17:02:44.967 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:44 +0000 (0:00:00.086) 0:02:10.353 ***** 2021-02-13T17:02:44.973 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-02-13T17:02:44.973 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-02-13T17:02:45.012 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:45 +0000 (0:00:00.045) 0:02:10.399 ***** 2021-02-13T17:02:45.040 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-02-13T17:02:45.041 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.076 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:45 +0000 (0:00:00.063) 0:02:10.463 ***** 2021-02-13T17:02:45.082 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-02-13T17:02:45.083 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-02-13T17:02:45.124 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:45 +0000 (0:00:00.048) 0:02:10.511 ***** 2021-02-13T17:02:45.132 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-02-13T17:02:45.133 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.134 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.135 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.174 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:45 +0000 (0:00:00.049) 0:02:10.560 ***** 2021-02-13T17:02:45.179 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-02-13T17:02:45.181 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.223 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:45 +0000 (0:00:00.049) 0:02:10.610 ***** 2021-02-13T17:02:45.231 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-02-13T17:02:45.232 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.233 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.234 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.274 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:45 +0000 (0:00:00.050) 0:02:10.660 ***** 2021-02-13T17:02:45.280 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-02-13T17:02:45.282 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.283 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.323 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:45 +0000 (0:00:00.049) 0:02:10.710 ***** 2021-02-13T17:02:45.331 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.372 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:45 +0000 (0:00:00.048) 0:02:10.759 ***** 2021-02-13T17:02:45.379 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-02-13T17:02:45.381 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.382 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba037.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.383 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.395 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.433 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:45 +0000 (0:00:00.060) 0:02:10.819 ***** 2021-02-13T17:02:45.440 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.487 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:45 +0000 (0:00:00.054) 0:02:10.874 ***** 2021-02-13T17:02:45.493 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:02:45.494 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.539 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:45 +0000 (0:00:00.052) 0:02:10.926 ***** 2021-02-13T17:02:45.546 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-02-13T17:02:45.547 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.587 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:45 +0000 (0:00:00.048) 0:02:10.974 ***** 2021-02-13T17:02:45.595 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-02-13T17:02:45.596 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.633 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:45 +0000 (0:00:00.045) 0:02:11.020 ***** 2021-02-13T17:02:45.640 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-02-13T17:02:45.640 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.677 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:45 +0000 (0:00:00.044) 0:02:11.064 ***** 2021-02-13T17:02:45.684 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-02-13T17:02:45.685 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.728 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:45 +0000 (0:00:00.050) 0:02:11.115 ***** 2021-02-13T17:02:45.734 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-02-13T17:02:45.736 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.776 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:45 +0000 (0:00:00.047) 0:02:11.163 ***** 2021-02-13T17:02:45.782 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-02-13T17:02:45.784 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.821 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:45 +0000 (0:00:00.044) 0:02:11.208 ***** 2021-02-13T17:02:45.828 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-13T17:02:45.829 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.868 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:45 +0000 (0:00:00.047) 0:02:11.255 ***** 2021-02-13T17:02:45.876 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-02-13T17:02:45.878 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.922 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:45 +0000 (0:00:00.053) 0:02:11.309 ***** 2021-02-13T17:02:45.930 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-02-13T17:02:45.931 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:45.971 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:45 +0000 (0:00:00.048) 0:02:11.357 ***** 2021-02-13T17:02:45.978 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-13T17:02:45.979 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:46.023 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:46 +0000 (0:00:00.052) 0:02:11.410 ***** 2021-02-13T17:02:46.030 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-13T17:02:46.031 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:46.067 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:46 +0000 (0:00:00.044) 0:02:11.454 ***** 2021-02-13T17:02:46.073 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-02-13T17:02:46.075 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:46.113 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:46 +0000 (0:00:00.045) 0:02:11.500 ***** 2021-02-13T17:02:46.140 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-13T17:02:46.142 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:46.181 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:46 +0000 (0:00:00.068) 0:02:11.568 ***** 2021-02-13T17:02:46.188 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-13T17:02:46.188 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002329", "end": "2021-02-13 17:02:46.035696", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-02-13 17:02:46.033367", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:46.252 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001352", "end": "2021-02-13 17:02:46.119986", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-02-13 17:02:46.118634", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:46.295 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002268", "end": "2021-02-13 17:02:46.260724", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-02-13 17:02:46.258456", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:46.338 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001375", "end": "2021-02-13 17:02:46.202489", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-02-13 17:02:46.201114", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:46.370 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001348", "end": "2021-02-13 17:02:46.339162", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-02-13 17:02:46.337814", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:46.434 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.012439", "end": "2021-02-13 17:02:46.294802", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-02-13 17:02:46.282363", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:46.474 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:46 +0000 (0:00:00.292) 0:02:11.860 ***** 2021-02-13T17:02:46.481 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001347", "end": "2021-02-13 17:02:46.420265", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-02-13 17:02:46.418918", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:46.503 INFO:teuthology.task.ansible.out: 2021-02-13T17:02:46.504 INFO:teuthology.task.ansible.out:TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-02-13T17:02:46.541 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:46 +0000 (0:00:00.067) 0:02:11.928 ***** 2021-02-13T17:02:46.548 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-13T17:02:46.548 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.012347", "end": "2021-02-13 17:02:46.503193", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-02-13 17:02:46.490846", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:02:46.591 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:46 +0000 (0:00:00.049) 0:02:11.977 ***** 2021-02-13T17:02:46.620 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-02-13T17:02:46.657 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:46 +0000 (0:00:00.066) 0:02:12.044 ***** 2021-02-13T17:02:46.665 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-02-13T17:02:46.666 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-02-13T17:02:46.751 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-02-13T17:02:46.867 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-02-13T17:02:46.902 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:46 +0000 (0:00:00.244) 0:02:12.289 ***** 2021-02-13T17:02:46.936 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:46 +0000 (0:00:00.033) 0:02:12.323 ***** 2021-02-13T17:02:47.399 INFO:teuthology.task.ansible.out: 2021-02-13T17:02:47.400 INFO:teuthology.task.ansible.out:TASK [Gathering Facts] ********************************************************* ok: [gibba037.front.sepia.ceph.com] 2021-02-13T17:02:47.486 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:47 +0000 (0:00:00.549) 0:02:12.872 ***** 2021-02-13T17:02:47.497 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] 2021-02-13T17:02:47.544 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-13T17:02:47.545 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-02-13T17:02:47.581 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:47 +0000 (0:00:00.095) 0:02:12.968 ***** 2021-02-13T17:02:47.618 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:47 +0000 (0:00:00.037) 0:02:13.005 ***** 2021-02-13T17:02:47.627 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-13T17:02:47.628 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:47.672 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:47 +0000 (0:00:00.054) 0:02:13.059 ***** 2021-02-13T17:02:47.679 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-13T17:02:47.680 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-02-13T17:02:47.717 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:47 +0000 (0:00:00.044) 0:02:13.104 ***** 2021-02-13T17:02:47.733 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-02-13T17:02:47.734 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-02-13T17:02:47.770 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:47 +0000 (0:00:00.053) 0:02:13.157 ***** 2021-02-13T17:02:47.777 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-13T17:02:47.778 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:47.816 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:47 +0000 (0:00:00.045) 0:02:13.203 ***** 2021-02-13T17:02:47.855 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-02-13T17:02:47.856 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-02-13T17:02:47.894 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:47 +0000 (0:00:00.077) 0:02:13.281 ***** 2021-02-13T17:02:56.864 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-02-13T17:02:56.865 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"cache_update_time": 1613235443, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSuggested packages:\n aufs-tools debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 78 not upgraded.\nNeed to get 39.9 MB of archives.\nAfter this operation, 1024 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 docker.io amd64 19.03.6-0ubuntu1~18.04.3 [39.9 MB]\nPreconfiguring packages ...\nFetched 39.9 MB in 2s (21.6 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137603 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_19.03.6-0ubuntu1~18.04.3_amd64.deb ...\r\nUnpacking docker.io (19.03.6-0ubuntu1~18.04.3) over (19.03.6-0ubuntu1~18.04.2) ...\r\nSetting up docker.io (19.03.6-0ubuntu1~18.04.3) ...\r\ndocker.service is a disabled or a static unit, not starting it.\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Suggested packages:", " aufs-tools debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly 2021-02-13T17:02:56.867 INFO:teuthology.task.ansible.out: installed, 0 to remove and 78 not upgraded.", "Need to get 39.9 MB of archives.", "After this operation, 1024 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 docker.io amd64 19.03.6-0ubuntu1~18.04.3 [39.9 MB]", "Preconfiguring packages ...", "Fetched 39.9 MB in 2s (21.6 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137603 files and directories currently installed.)", "Preparing to unpack .../docker.io_19.03.6-0ubuntu1~18.04.3_amd64.deb ...", "Unpacking docker.io (19.03.6-0ubuntu1~18.04.3) over (19.03.6-0ubuntu1~18.04.2) ...", "Setting up docker.io (19.03.6-0ubuntu1~18.04.3) ...", "docker.service is a disabled or a static unit, not starting it.", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ..."]} 2021-02-13T17:02:56.905 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:56 +0000 (0:00:09.011) 0:02:22.292 ***** 2021-02-13T17:02:56.932 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-13T17:02:56.934 INFO:teuthology.task.ansible.out:skipping: [gibba037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:56.970 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:56 +0000 (0:00:00.064) 0:02:22.357 ***** 2021-02-13T17:02:57.008 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-13T17:02:57.009 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-02-13T17:02:57.056 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:57 +0000 (0:00:00.086) 0:02:22.443 ***** 2021-02-13T17:02:57.169 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* changed: [gibba037.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-02-13T17:02:57.240 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-02-13T17:02:57.282 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:57 +0000 (0:00:00.225) 0:02:22.669 ***** 2021-02-13T17:02:57.362 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-02-13T17:02:57.363 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1613235472, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSuggested packages:\n aufs-tools debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 78 not upgraded.\nNeed to get 39.9 MB of archives.\nAfter this operation, 1024 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 docker.io amd64 19.03.6-0ubuntu1~18.04.3 [39.9 MB]\nPreconfiguring packages ...\nFetched 39.9 MB in 2s (21.3 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137603 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_19.03.6-0ubuntu1~18.04.3_amd64.deb ...\r\nUnpacking docker.io (19.03.6-0ubuntu1~18.04.3) over (19.03.6-0ubuntu1~18.04.2) ...\r\nSetting up docker.io (19.03.6-0ubuntu1~18.04.3) ...\r\ndocker.service is a disabled or a static unit, not starting it.\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Suggested packages:", " aufs-tools debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly 2021-02-13T17:02:57.364 INFO:teuthology.task.ansible.out: installed, 0 to remove and 78 not upgraded.", "Need to get 39.9 MB of archives.", "After this operation, 1024 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 docker.io amd64 19.03.6-0ubuntu1~18.04.3 [39.9 MB]", "Preconfiguring packages ...", "Fetched 39.9 MB in 2s (21.3 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137603 files and directories currently installed.)", "Preparing to unpack .../docker.io_19.03.6-0ubuntu1~18.04.3_amd64.deb ...", "Unpacking docker.io (19.03.6-0ubuntu1~18.04.3) over (19.03.6-0ubuntu1~18.04.2) ...", "Setting up docker.io (19.03.6-0ubuntu1~18.04.3) ...", "docker.service is a disabled or a static unit, not starting it.", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ..."]} 2021-02-13T17:02:57.404 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:57 +0000 (0:00:00.122) 0:02:22.791 ***** 2021-02-13T17:02:57.433 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:02:57.475 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:57 +0000 (0:00:00.070) 0:02:22.861 ***** 2021-02-13T17:02:57.512 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-13T17:02:57.513 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-02-13T17:02:57.559 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:57 +0000 (0:00:00.084) 0:02:22.946 ***** 2021-02-13T17:02:57.566 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-02-13T17:02:57.567 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613235777.3235023-135074762720202/source", "state": "file", "uid": 0} 2021-02-13T17:02:57.695 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-02-13T17:02:57.696 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-02-13T17:02:57.780 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-02-13T17:02:57.819 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:57 +0000 (0:00:00.260) 0:02:23.206 ***** 2021-02-13T17:02:57.825 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-02-13T17:02:57.826 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613235777.5545666-132351133012414/source", "state": "file", "uid": 0} 2021-02-13T17:02:57.867 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:57 +0000 (0:00:00.047) 0:02:23.254 ***** 2021-02-13T17:02:58.095 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613235777.8546667-167528314674414/source", "state": "file", "uid": 0} 2021-02-13T17:02:58.294 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613235778.1009555-21498972908280/source", "state": "file", "uid": 0} 2021-02-13T17:02:58.334 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:02:58 +0000 (0:00:00.467) 0:02:23.721 ***** 2021-02-13T17:03:00.333 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-02-13T17:03:00.334 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-NaGIRX-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-NaGIRX-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/package 2021-02-13T17:03:00.336 INFO:teuthology.task.ansible.out:s/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-02-13T17:03:00.374 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:03:00 +0000 (0:00:02.040) 0:02:25.761 ***** 2021-02-13T17:03:00.484 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-02-13T17:03:00.485 INFO:teuthology.task.ansible.out:ok: [gibba037.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-02-13T17:03:00.525 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:03:00 +0000 (0:00:00.150) 0:02:25.912 ***** 2021-02-13T17:03:00.794 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-02-13T17:03:00.795 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613235780.5655644-255121993135876/source", "state": "file", "uid": 0} 2021-02-13T17:03:00.837 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:03:00 +0000 (0:00:00.311) 0:02:26.224 ***** 2021-02-13T17:03:00.877 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-02-13T17:03:00.877 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-yMPEge-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-yMPEge-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/package 2021-02-13T17:03:00.878 INFO:teuthology.task.ansible.out:s/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-02-13T17:03:00.927 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:03:00 +0000 (0:00:00.089) 0:02:26.314 ***** 2021-02-13T17:03:01.060 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-02-13T17:03:01.061 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.099087", "end": "2021-02-13 17:03:01.026926", "rc": 0, "start": "2021-02-13 17:03:00.927839", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:03:01.102 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:03:01 +0000 (0:00:00.174) 0:02:26.488 ***** 2021-02-13T17:03:01.110 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-02-13T17:03:01.110 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-02-13T17:03:01.155 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:03:01 +0000 (0:00:00.052) 0:02:26.541 ***** 2021-02-13T17:03:01.428 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-02-13T17:03:01.430 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613235781.1950593-160586914153363/source", "state": "file", "uid": 0} 2021-02-13T17:03:01.466 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:03:01 +0000 (0:00:00.311) 0:02:26.853 ***** 2021-02-13T17:03:01.651 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-02-13T17:03:01.653 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.081610", "end": "2021-02-13 17:03:01.526761", "rc": 0, "start": "2021-02-13 17:03:01.445151", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:03:01.697 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:03:01 +0000 (0:00:00.230) 0:02:27.083 ***** 2021-02-13T17:03:03.721 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-02-13T17:03:03.722 INFO:teuthology.task.ansible.out:changed: [gibba037.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "network-online.target docker.socket basic.target system.slice containerd.service sysinit.target firewalld.service systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMai 2021-02-13T17:03:03.723 INFO:teuthology.task.ansible.out:nStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128079", "LimitSIGPENDINGSoft": "128079 2021-02-13T17:03:03.724 INFO:teuthology.task.ansible.out:", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice docker.socket sysinit.target", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2021-02-13 17:01:53 UTC", "StateChangeTimestampMonotonic": "112083981", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "Su 2021-02-13T17:03:03.726 INFO:teuthology.task.ansible.out:ccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-02-13T17:03:04.278 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice containerd.service firewalld.service network-online.target docker.socket sysinit.target systemd-journald.socket basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMai 2021-02-13T17:03:04.279 INFO:teuthology.task.ansible.out:nStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128079", "LimitSIGPENDINGSoft": "128079 2021-02-13T17:03:04.280 INFO:teuthology.task.ansible.out:", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2021-02-13 17:01:53 UTC", "StateChangeTimestampMonotonic": "107746397", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "Su 2021-02-13T17:03:04.282 INFO:teuthology.task.ansible.out:ccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-02-13T17:03:04.385 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-02-13T17:03:04.389 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-02-13T17:03:04.393 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* 2021-02-13T17:03:04.395 INFO:teuthology.task.ansible.out:gibba037.front.sepia.ceph.com : ok=126 changed=41 unreachable=0 failed=0 skipped=184 rescued=0 ignored=0 gibba038.front.sepia.ceph.com : ok=126 changed=41 unreachable=0 failed=0 skipped=184 rescued=0 ignored=0 Saturday 13 February 2021 17:03:04 +0000 (0:00:02.696) 0:02:29.780 ***** =============================================================================== users : Update authorized_keys using the keys repo --------------------- 15.83s users : Create all admin users with sudo access. ----------------------- 14.28s container-host : Install container packages ----------------------------- 9.01s testnode : Zap all non-root disks --------------------------------------- 7.86s testnode : Upgrade packages --------------------------------------------- 7.63s testnode : Ensure packages are not present. ----------------------------- 7.38s testnode : Install packages --------------------------------------------- 7.14s users : Remove revoked users -------------------------------------------- 5.07s container-host : Restart docker service --------------------------------- 2.70s common : Update apt cache ----------------------------------------------- 2.17s container-host : Install registries-conf-ctl ---------------------------- 2.04s testnode : Update apt cache. -------------------------------------------- 1.96s Gathering Facts --------------------------------------------------------- 1.82s users : Update authorized_keys for each user with literal keys ---------- 1.71s testnode : Install apt keys --------------------------------------------- 1.55s testnode : Create logical volume(s) ------------------------------------- 1.13s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.11s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.84s ansible-managed : Add authorized keys for the ansible user. ------------- 0.84s testnode : Install packages via pip --------------- 2021-02-13T17:03:04.396 INFO:teuthology.task.ansible.out:---------------------- 0.73s 2021-02-13T17:03:04.722 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@gibba037.front.sepia.ceph.com'), Remote(name='ubuntu@gibba038.front.sepia.ceph.com')] 2021-02-13T17:03:04.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T17:03:04.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:03:04.843 DEBUG:teuthology.orchestra.run.gibba037:> true 2021-02-13T17:03:04.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T17:03:04.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:03:05.085 DEBUG:teuthology.orchestra.run.gibba038:> true 2021-02-13T17:03:05.205 INFO:teuthology.run_tasks:Running task clock... 2021-02-13T17:03:05.249 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-02-13T17:03:05.250 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-02-13T17:03:05.251 DEBUG:teuthology.orchestra.run.gibba037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-13T17:03:05.300 INFO:teuthology.orchestra.run.gibba037.stdout:13 Feb 17:03:05 ntpd[10464]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-02-13T17:03:05.301 INFO:teuthology.orchestra.run.gibba037.stdout:13 Feb 17:03:05 ntpd[10464]: Command line: ntpd -gq 2021-02-13T17:03:05.301 INFO:teuthology.orchestra.run.gibba037.stdout:13 Feb 17:03:05 ntpd[10464]: proto: precision = 0.045 usec (-24) 2021-02-13T17:03:05.301 INFO:teuthology.orchestra.run.gibba037.stdout:13 Feb 17:03:05 ntpd[10464]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-02-13T17:03:05.301 INFO:teuthology.orchestra.run.gibba037.stdout:13 Feb 17:03:05 ntpd[10464]: restrict ::: KOD does nothing without LIMITED. 2021-02-13T17:03:05.301 INFO:teuthology.orchestra.run.gibba037.stdout:13 Feb 17:03:05 ntpd[10464]: Listen and drop on 0 v6wildcard [::]:123 2021-02-13T17:03:05.301 INFO:teuthology.orchestra.run.gibba037.stdout:13 Feb 17:03:05 ntpd[10464]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-02-13T17:03:05.301 INFO:teuthology.orchestra.run.gibba037.stdout:13 Feb 17:03:05 ntpd[10464]: Listen normally on 2 lo 127.0.0.1:123 2021-02-13T17:03:05.301 INFO:teuthology.orchestra.run.gibba037.stdout:13 Feb 17:03:05 ntpd[10464]: Listen normally on 3 enp1s0f0 172.21.2.137:123 2021-02-13T17:03:05.301 INFO:teuthology.orchestra.run.gibba037.stdout:13 Feb 17:03:05 ntpd[10464]: Listen normally on 4 lo [::1]:123 2021-02-13T17:03:05.301 INFO:teuthology.orchestra.run.gibba037.stdout:13 Feb 17:03:05 ntpd[10464]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:8de2%2]:123 2021-02-13T17:03:05.301 INFO:teuthology.orchestra.run.gibba037.stdout:13 Feb 17:03:05 ntpd[10464]: Listening on routing socket on fd #22 for interface updates 2021-02-13T17:03:05.301 INFO:teuthology.orchestra.run.gibba037.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-02-13T17:03:05.302 INFO:teuthology.orchestra.run.gibba037.stderr:restrict ::: KOD does nothing without LIMITED. 2021-02-13T17:03:06.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:06 ntpd[10464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:06.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:06 ntpd[10464]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:06.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:06 ntpd[10464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:06.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:06 ntpd[10464]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:07.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:07 ntpd[10464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:07.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:07 ntpd[10464]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:07.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:07 ntpd[10464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:07.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:07 ntpd[10464]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:08.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:08 ntpd[10464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:08.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:08 ntpd[10464]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:08.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:08 ntpd[10464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:08.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:08 ntpd[10464]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:08.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:08 ntpd[10464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:08.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:08 ntpd[10464]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:08.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:08 ntpd[10464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:08.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:08 ntpd[10464]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:09.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:09 ntpd[10464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:09.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:09 ntpd[10464]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:09.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:09 ntpd[10464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:09.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:09 ntpd[10464]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:09.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:09 ntpd[10464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:09.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:09 ntpd[10464]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:09.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:09 ntpd[10464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:09.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:09 ntpd[10464]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:10.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:10 ntpd[10464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:10.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:10 ntpd[10464]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:10.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:10 ntpd[10464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:10.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:10 ntpd[10464]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:10.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:10 ntpd[10464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:10.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:10 ntpd[10464]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:10.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:10 ntpd[10464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:10.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:10 ntpd[10464]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:11.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:11 ntpd[10464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:11.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:11 ntpd[10464]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:11.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:11 ntpd[10464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:11.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:11 ntpd[10464]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:11.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:11 ntpd[10464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:11.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:11 ntpd[10464]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:11.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:11 ntpd[10464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:11.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:11 ntpd[10464]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:12.300 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:12 ntpd[10464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:12.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:12 ntpd[10464]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:12.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:12 ntpd[10464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:12.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:12 ntpd[10464]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:12.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:12 ntpd[10464]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-02-13T17:03:12.301 INFO:teuthology.orchestra.run.gibba037.stderr:13 Feb 17:03:12 ntpd[10464]: can't open /var/log/ntpstats/loopstats.20210213: Permission denied 2021-02-13T17:03:12.301 INFO:teuthology.orchestra.run.gibba037.stdout:13 Feb 17:03:12 ntpd[10464]: ntpd: time slew +0.005434 s 2021-02-13T17:03:12.301 INFO:teuthology.orchestra.run.gibba037.stdout:ntpd: time slew +0.005434s 2021-02-13T17:03:12.329 INFO:teuthology.orchestra.run.gibba037.stdout: remote refid st t when poll reach delay offset jitter 2021-02-13T17:03:12.329 INFO:teuthology.orchestra.run.gibba037.stdout:============================================================================== 2021-02-13T17:03:12.329 INFO:teuthology.orchestra.run.gibba037.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-13T17:03:12.329 INFO:teuthology.orchestra.run.gibba037.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-13T17:03:12.329 INFO:teuthology.orchestra.run.gibba037.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-13T17:03:12.330 INFO:teuthology.orchestra.run.gibba037.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-13T17:03:12.330 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-02-13T17:03:12.330 DEBUG:teuthology.orchestra.run.gibba038:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-13T17:03:12.390 INFO:teuthology.orchestra.run.gibba038.stdout:13 Feb 17:03:12 ntpd[10419]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-02-13T17:03:12.390 INFO:teuthology.orchestra.run.gibba038.stdout:13 Feb 17:03:12 ntpd[10419]: Command line: ntpd -gq 2021-02-13T17:03:12.390 INFO:teuthology.orchestra.run.gibba038.stdout:13 Feb 17:03:12 ntpd[10419]: proto: precision = 0.049 usec (-24) 2021-02-13T17:03:12.390 INFO:teuthology.orchestra.run.gibba038.stdout:13 Feb 17:03:12 ntpd[10419]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-02-13T17:03:12.390 INFO:teuthology.orchestra.run.gibba038.stdout:13 Feb 17:03:12 ntpd[10419]: restrict ::: KOD does nothing without LIMITED. 2021-02-13T17:03:12.390 INFO:teuthology.orchestra.run.gibba038.stdout:13 Feb 17:03:12 ntpd[10419]: Listen and drop on 0 v6wildcard [::]:123 2021-02-13T17:03:12.390 INFO:teuthology.orchestra.run.gibba038.stdout:13 Feb 17:03:12 ntpd[10419]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-02-13T17:03:12.390 INFO:teuthology.orchestra.run.gibba038.stdout:13 Feb 17:03:12 ntpd[10419]: Listen normally on 2 lo 127.0.0.1:123 2021-02-13T17:03:12.390 INFO:teuthology.orchestra.run.gibba038.stdout:13 Feb 17:03:12 ntpd[10419]: Listen normally on 3 enp1s0f0 172.21.2.138:123 2021-02-13T17:03:12.391 INFO:teuthology.orchestra.run.gibba038.stdout:13 Feb 17:03:12 ntpd[10419]: Listen normally on 4 lo [::1]:123 2021-02-13T17:03:12.391 INFO:teuthology.orchestra.run.gibba038.stdout:13 Feb 17:03:12 ntpd[10419]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:9112%2]:123 2021-02-13T17:03:12.391 INFO:teuthology.orchestra.run.gibba038.stdout:13 Feb 17:03:12 ntpd[10419]: Listening on routing socket on fd #22 for interface updates 2021-02-13T17:03:12.391 INFO:teuthology.orchestra.run.gibba038.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-02-13T17:03:12.391 INFO:teuthology.orchestra.run.gibba038.stderr:restrict ::: KOD does nothing without LIMITED. 2021-02-13T17:03:13.390 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:13 ntpd[10419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:13.390 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:13 ntpd[10419]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:13.390 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:13 ntpd[10419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:13.390 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:13 ntpd[10419]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:13.391 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:13 ntpd[10419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:13.391 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:13 ntpd[10419]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:13.391 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:13 ntpd[10419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:13.391 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:13 ntpd[10419]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:14.389 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:14 ntpd[10419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:14.389 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:14 ntpd[10419]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:14.389 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:14 ntpd[10419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:14.389 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:14 ntpd[10419]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:15.389 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:15 ntpd[10419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:15.389 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:15 ntpd[10419]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:15.389 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:15 ntpd[10419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:15.389 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:15 ntpd[10419]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:15.389 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:15 ntpd[10419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:15.390 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:15 ntpd[10419]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:15.390 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:15 ntpd[10419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:15.390 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:15 ntpd[10419]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:15.390 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:15 ntpd[10419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:15.390 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:15 ntpd[10419]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:15.390 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:15 ntpd[10419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:15.390 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:15 ntpd[10419]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:16.387 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:16 ntpd[10419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:16.388 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:16 ntpd[10419]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:16.388 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:16 ntpd[10419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:16.388 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:16 ntpd[10419]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:17.388 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:17 ntpd[10419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:17.388 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:17 ntpd[10419]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:17.388 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:17 ntpd[10419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:17.388 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:17 ntpd[10419]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:17.388 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:17 ntpd[10419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:17.389 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:17 ntpd[10419]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:17.389 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:17 ntpd[10419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:17.389 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:17 ntpd[10419]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:17.389 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:17 ntpd[10419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:17.389 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:17 ntpd[10419]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:17.389 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:17 ntpd[10419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:17.389 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:17 ntpd[10419]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:18.387 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:18 ntpd[10419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:18.387 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:18 ntpd[10419]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:18.387 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:18 ntpd[10419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:18.387 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:18 ntpd[10419]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:19.387 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:19 ntpd[10419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:03:19.387 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:19 ntpd[10419]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:03:19.387 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:19 ntpd[10419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:03:19.387 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:19 ntpd[10419]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:03:19.387 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:19 ntpd[10419]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-02-13T17:03:19.387 INFO:teuthology.orchestra.run.gibba038.stderr:13 Feb 17:03:19 ntpd[10419]: can't open /var/log/ntpstats/loopstats.20210213: Permission denied 2021-02-13T17:03:19.387 INFO:teuthology.orchestra.run.gibba038.stdout:13 Feb 17:03:19 ntpd[10419]: ntpd: time set +0.096538 s 2021-02-13T17:03:19.387 INFO:teuthology.orchestra.run.gibba038.stdout:ntpd: time set +0.096538s 2021-02-13T17:03:19.421 INFO:teuthology.orchestra.run.gibba038.stdout: remote refid st t when poll reach delay offset jitter 2021-02-13T17:03:19.421 INFO:teuthology.orchestra.run.gibba038.stdout:============================================================================== 2021-02-13T17:03:19.421 INFO:teuthology.orchestra.run.gibba038.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-13T17:03:19.421 INFO:teuthology.orchestra.run.gibba038.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-13T17:03:19.421 INFO:teuthology.orchestra.run.gibba038.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-13T17:03:19.421 INFO:teuthology.orchestra.run.gibba038.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-13T17:03:19.421 INFO:teuthology.run_tasks:Running task install... 2021-02-13T17:03:19.437 DEBUG:teuthology.task.install:project ceph 2021-02-13T17:03:19.437 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1'}} 2021-02-13T17:03:19.437 DEBUG:teuthology.task.install:config {'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1'} 2021-02-13T17:03:19.437 INFO:teuthology.task.install:Using flavor: basic 2021-02-13T17:03:19.441 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python-ceph', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-ssh', 'ceph-fuse', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python-ceph', 'rbd-fuse']} 2021-02-13T17:03:19.441 INFO:teuthology.task.install:extra packages: [] 2021-02-13T17:03:19.442 DEBUG:teuthology.orchestra.run.gibba037:> sudo lsb_release -is 2021-02-13T17:03:19.471 INFO:teuthology.orchestra.run.gibba037.stdout:Ubuntu 2021-02-13T17:03:19.473 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-13T17:03:19.474 DEBUG:teuthology.orchestra.run.gibba038:> sudo lsb_release -is 2021-02-13T17:03:19.474 DEBUG:teuthology.orchestra.run.gibba037:> sudo apt-key list | grep Ceph 2021-02-13T17:03:19.503 INFO:teuthology.orchestra.run.gibba038.stdout:Ubuntu 2021-02-13T17:03:19.505 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-13T17:03:19.506 DEBUG:teuthology.orchestra.run.gibba038:> sudo apt-key list | grep Ceph 2021-02-13T17:03:19.570 INFO:teuthology.orchestra.run.gibba037.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-02-13T17:03:19.590 INFO:teuthology.orchestra.run.gibba037.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-02-13T17:03:19.591 INFO:teuthology.orchestra.run.gibba037.stdout:uid [ unknown] Ceph.com (release key) 2021-02-13T17:03:19.591 DEBUG:teuthology.orchestra.run.gibba037:> sudo lsb_release -is 2021-02-13T17:03:19.599 INFO:teuthology.orchestra.run.gibba038.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-02-13T17:03:19.617 INFO:teuthology.orchestra.run.gibba038.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-02-13T17:03:19.618 INFO:teuthology.orchestra.run.gibba038.stdout:uid [ unknown] Ceph.com (release key) 2021-02-13T17:03:19.618 DEBUG:teuthology.orchestra.run.gibba038:> sudo lsb_release -is 2021-02-13T17:03:19.618 INFO:teuthology.orchestra.run.gibba037.stdout:Ubuntu 2021-02-13T17:03:19.620 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-13T17:03:19.621 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python-ceph, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-02-13T17:03:19.621 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=7194982cc16a1fd51df59ee58e1c54797c4465d1 2021-02-13T17:03:19.643 INFO:teuthology.orchestra.run.gibba038.stdout:Ubuntu 2021-02-13T17:03:19.646 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-13T17:03:19.646 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python-ceph, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-02-13T17:03:19.646 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=7194982cc16a1fd51df59ee58e1c54797c4465d1 2021-02-13T17:03:19.793 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default/ 2021-02-13T17:03:19.794 INFO:teuthology.task.install.deb:Package version is 14.2.16-285-g7194982c-1bionic 2021-02-13T17:03:19.807 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default/ 2021-02-13T17:03:19.807 INFO:teuthology.task.install.deb:Package version is 14.2.16-285-g7194982c-1bionic 2021-02-13T17:03:19.924 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-02-13T17:03:19.924 DEBUG:teuthology.orchestra.run.gibba037:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-02-13T17:03:19.935 DEBUG:teuthology.orchestra.run.gibba037:> sudo apt-get update 2021-02-13T17:03:19.938 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-02-13T17:03:19.938 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-02-13T17:03:19.949 DEBUG:teuthology.orchestra.run.gibba038:> sudo apt-get update 2021-02-13T17:03:20.068 INFO:teuthology.orchestra.run.gibba037.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-02-13T17:03:20.105 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-02-13T17:03:20.123 INFO:teuthology.orchestra.run.gibba037.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic InRelease 2021-02-13T17:03:20.146 INFO:teuthology.orchestra.run.gibba037.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic Release [7,663 B] 2021-02-13T17:03:20.168 INFO:teuthology.orchestra.run.gibba038.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic InRelease 2021-02-13T17:03:20.177 INFO:teuthology.orchestra.run.gibba037.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic Release.gpg 2021-02-13T17:03:20.180 INFO:teuthology.orchestra.run.gibba037.stdout:Hit:5 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-13T17:03:20.205 INFO:teuthology.orchestra.run.gibba038.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic Release [7,663 B] 2021-02-13T17:03:20.209 INFO:teuthology.orchestra.run.gibba037.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.7 kB] 2021-02-13T17:03:20.218 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-13T17:03:20.234 INFO:teuthology.orchestra.run.gibba038.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic Release.gpg 2021-02-13T17:03:20.241 INFO:teuthology.orchestra.run.gibba037.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,585 B] 2021-02-13T17:03:20.257 INFO:teuthology.orchestra.run.gibba038.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.7 kB] 2021-02-13T17:03:20.258 INFO:teuthology.orchestra.run.gibba037.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-02-13T17:03:20.283 INFO:teuthology.orchestra.run.gibba038.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,585 B] 2021-02-13T17:03:20.298 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-02-13T17:03:20.337 INFO:teuthology.orchestra.run.gibba037.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-02-13T17:03:20.378 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-02-13T17:03:20.505 INFO:teuthology.orchestra.run.gibba038.stdout:Fetched 26.0 kB in 0s (68.3 kB/s) 2021-02-13T17:03:20.551 INFO:teuthology.orchestra.run.gibba037.stdout:Fetched 26.0 kB in 0s (52.9 kB/s) 2021-02-13T17:03:21.333 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-02-13T17:03:21.359 DEBUG:teuthology.orchestra.run.gibba038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.16-285-g7194982c-1bionic ceph-mds=14.2.16-285-g7194982c-1bionic ceph-mgr=14.2.16-285-g7194982c-1bionic ceph-common=14.2.16-285-g7194982c-1bionic ceph-fuse=14.2.16-285-g7194982c-1bionic ceph-test=14.2.16-285-g7194982c-1bionic radosgw=14.2.16-285-g7194982c-1bionic python-ceph=14.2.16-285-g7194982c-1bionic libcephfs2=14.2.16-285-g7194982c-1bionic libcephfs-dev=14.2.16-285-g7194982c-1bionic librados2=14.2.16-285-g7194982c-1bionic librbd1=14.2.16-285-g7194982c-1bionic rbd-fuse=14.2.16-285-g7194982c-1bionic 2021-02-13T17:03:21.389 INFO:teuthology.orchestra.run.gibba037.stdout:Reading package lists... 2021-02-13T17:03:21.403 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-02-13T17:03:21.415 DEBUG:teuthology.orchestra.run.gibba037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.16-285-g7194982c-1bionic ceph-mds=14.2.16-285-g7194982c-1bionic ceph-mgr=14.2.16-285-g7194982c-1bionic ceph-common=14.2.16-285-g7194982c-1bionic ceph-fuse=14.2.16-285-g7194982c-1bionic ceph-test=14.2.16-285-g7194982c-1bionic radosgw=14.2.16-285-g7194982c-1bionic python-ceph=14.2.16-285-g7194982c-1bionic libcephfs2=14.2.16-285-g7194982c-1bionic libcephfs-dev=14.2.16-285-g7194982c-1bionic librados2=14.2.16-285-g7194982c-1bionic librbd1=14.2.16-285-g7194982c-1bionic rbd-fuse=14.2.16-285-g7194982c-1bionic 2021-02-13T17:03:21.460 INFO:teuthology.orchestra.run.gibba037.stdout:Reading package lists... 2021-02-13T17:03:21.566 INFO:teuthology.orchestra.run.gibba038.stdout:Building dependency tree... 2021-02-13T17:03:21.566 INFO:teuthology.orchestra.run.gibba038.stdout:Reading state information... 2021-02-13T17:03:21.625 INFO:teuthology.orchestra.run.gibba037.stdout:Building dependency tree... 2021-02-13T17:03:21.626 INFO:teuthology.orchestra.run.gibba037.stdout:Reading state information... 2021-02-13T17:03:21.662 INFO:teuthology.orchestra.run.gibba038.stdout:The following additional packages will be installed: 2021-02-13T17:03:21.663 INFO:teuthology.orchestra.run.gibba038.stdout: ceph-base ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-02-13T17:03:21.663 INFO:teuthology.orchestra.run.gibba038.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh 2021-02-13T17:03:21.663 INFO:teuthology.orchestra.run.gibba038.stdout: ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc libjs-underscore 2021-02-13T17:03:21.663 INFO:teuthology.orchestra.run.gibba038.stdout: libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 libradosstriper1 2021-02-13T17:03:21.663 INFO:teuthology.orchestra.run.gibba038.stdout: librgw2 libsnappy1v5 libxslt1.1 nvme-cli python-attr python-bcrypt 2021-02-13T17:03:21.663 INFO:teuthology.orchestra.run.gibba038.stdout: python-bs4 python-ceph-argparse python-cephfs python-certifi python-chardet 2021-02-13T17:03:21.663 INFO:teuthology.orchestra.run.gibba038.stdout: python-cherrypy3 python-decorator python-dnspython python-fasteners 2021-02-13T17:03:21.663 INFO:teuthology.orchestra.run.gibba038.stdout: python-formencode python-funcsigs python-html5lib python-httplib2 2021-02-13T17:03:21.663 INFO:teuthology.orchestra.run.gibba038.stdout: python-joblib python-jwt python-kubernetes python-logutils python-lxml 2021-02-13T17:03:21.663 INFO:teuthology.orchestra.run.gibba038.stdout: python-mako python-markupsafe python-monotonic python-oauth2client 2021-02-13T17:03:21.663 INFO:teuthology.orchestra.run.gibba038.stdout: python-openid python-openssl python-paste python-pastedeploy 2021-02-13T17:03:21.663 INFO:teuthology.orchestra.run.gibba038.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-pluggy 2021-02-13T17:03:21.664 INFO:teuthology.orchestra.run.gibba038.stdout: python-prettytable python-py python-pyasn1 python-pyasn1-modules 2021-02-13T17:03:21.664 INFO:teuthology.orchestra.run.gibba038.stdout: python-pyinotify python-pytest python-rados python-rbd python-repoze.lru 2021-02-13T17:03:21.664 INFO:teuthology.orchestra.run.gibba038.stdout: python-requests python-rgw python-routes python-rsa python-scgi python-scipy 2021-02-13T17:03:21.664 INFO:teuthology.orchestra.run.gibba038.stdout: python-simplegeneric python-simplejson python-singledispatch python-sklearn 2021-02-13T17:03:21.664 INFO:teuthology.orchestra.run.gibba038.stdout: python-sklearn-lib python-sqlalchemy python-sqlalchemy-ext python-tempita 2021-02-13T17:03:21.665 INFO:teuthology.orchestra.run.gibba038.stdout: python-uritemplate python-urllib3 python-waitress python-webencodings 2021-02-13T17:03:21.665 INFO:teuthology.orchestra.run.gibba038.stdout: python-webob python-websocket python-webtest python-werkzeug python-yaml 2021-02-13T17:03:21.665 INFO:teuthology.orchestra.run.gibba038.stdout: socat xmlstarlet 2021-02-13T17:03:21.665 INFO:teuthology.orchestra.run.gibba038.stdout:Suggested packages: 2021-02-13T17:03:21.665 INFO:teuthology.orchestra.run.gibba038.stdout: python-influxdb python-attr-doc python-egenix-mxdatetime python-funcsigs-doc 2021-02-13T17:03:21.665 INFO:teuthology.orchestra.run.gibba038.stdout: python-genshi python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2021-02-13T17:03:21.665 INFO:teuthology.orchestra.run.gibba038.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2021-02-13T17:03:21.665 INFO:teuthology.orchestra.run.gibba038.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2021-02-13T17:03:21.665 INFO:teuthology.orchestra.run.gibba038.stdout: python-cherrypy python-flup python-pecan-doc subversion python-pytest-xdist 2021-02-13T17:03:21.665 INFO:teuthology.orchestra.run.gibba038.stdout: python-pyinotify-doc python-mock python-socks python-scipy-doc python-dap 2021-02-13T17:03:21.665 INFO:teuthology.orchestra.run.gibba038.stdout: python-scikits-optimization python-sklearn-doc ipython python-sqlalchemy-doc 2021-02-13T17:03:21.666 INFO:teuthology.orchestra.run.gibba038.stdout: python-psycopg2 python-pymysql python-fdb python-pymssql python-ntlm 2021-02-13T17:03:21.666 INFO:teuthology.orchestra.run.gibba038.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-pyquery 2021-02-13T17:03:21.666 INFO:teuthology.orchestra.run.gibba038.stdout: python-redis python-pylibmc | python-memcache python-termcolor 2021-02-13T17:03:21.666 INFO:teuthology.orchestra.run.gibba038.stdout: python-watchdog python-werkzeug-doc 2021-02-13T17:03:21.713 INFO:teuthology.orchestra.run.gibba038.stdout:The following NEW packages will be installed: 2021-02-13T17:03:21.713 INFO:teuthology.orchestra.run.gibba038.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-dashboard 2021-02-13T17:03:21.713 INFO:teuthology.orchestra.run.gibba038.stdout: ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local 2021-02-13T17:03:21.713 INFO:teuthology.orchestra.run.gibba038.stdout: ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh ceph-mon ceph-osd ceph-test 2021-02-13T17:03:21.713 INFO:teuthology.orchestra.run.gibba038.stdout: formencode-i18n jq libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc 2021-02-13T17:03:21.713 INFO:teuthology.orchestra.run.gibba038.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 2021-02-13T17:03:21.713 INFO:teuthology.orchestra.run.gibba038.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 nvme-cli python-attr 2021-02-13T17:03:21.713 INFO:teuthology.orchestra.run.gibba038.stdout: python-bcrypt python-bs4 python-ceph python-ceph-argparse python-cephfs 2021-02-13T17:03:21.714 INFO:teuthology.orchestra.run.gibba038.stdout: python-certifi python-chardet python-cherrypy3 python-decorator 2021-02-13T17:03:21.714 INFO:teuthology.orchestra.run.gibba038.stdout: python-dnspython python-fasteners python-formencode python-funcsigs 2021-02-13T17:03:21.714 INFO:teuthology.orchestra.run.gibba038.stdout: python-html5lib python-httplib2 python-joblib python-jwt python-kubernetes 2021-02-13T17:03:21.714 INFO:teuthology.orchestra.run.gibba038.stdout: python-logutils python-lxml python-mako python-markupsafe python-monotonic 2021-02-13T17:03:21.714 INFO:teuthology.orchestra.run.gibba038.stdout: python-oauth2client python-openid python-openssl python-paste 2021-02-13T17:03:21.714 INFO:teuthology.orchestra.run.gibba038.stdout: python-pastedeploy python-pastedeploy-tpl python-pastescript python-pecan 2021-02-13T17:03:21.714 INFO:teuthology.orchestra.run.gibba038.stdout: python-pluggy python-prettytable python-py python-pyasn1 2021-02-13T17:03:21.714 INFO:teuthology.orchestra.run.gibba038.stdout: python-pyasn1-modules python-pyinotify python-pytest python-rados python-rbd 2021-02-13T17:03:21.714 INFO:teuthology.orchestra.run.gibba038.stdout: python-repoze.lru python-requests python-rgw python-routes python-rsa 2021-02-13T17:03:21.715 INFO:teuthology.orchestra.run.gibba038.stdout: python-scgi python-scipy python-simplegeneric python-simplejson 2021-02-13T17:03:21.715 INFO:teuthology.orchestra.run.gibba038.stdout: python-singledispatch python-sklearn python-sklearn-lib python-sqlalchemy 2021-02-13T17:03:21.715 INFO:teuthology.orchestra.run.gibba038.stdout: python-sqlalchemy-ext python-tempita python-uritemplate python-urllib3 2021-02-13T17:03:21.715 INFO:teuthology.orchestra.run.gibba038.stdout: python-waitress python-webencodings python-webob python-websocket 2021-02-13T17:03:21.715 INFO:teuthology.orchestra.run.gibba038.stdout: python-webtest python-werkzeug python-yaml radosgw rbd-fuse socat xmlstarlet 2021-02-13T17:03:21.715 INFO:teuthology.orchestra.run.gibba038.stdout:The following packages will be upgraded: 2021-02-13T17:03:21.715 INFO:teuthology.orchestra.run.gibba038.stdout: librados2 librbd1 2021-02-13T17:03:21.725 INFO:teuthology.orchestra.run.gibba037.stdout:The following additional packages will be installed: 2021-02-13T17:03:21.725 INFO:teuthology.orchestra.run.gibba037.stdout: ceph-base ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-02-13T17:03:21.725 INFO:teuthology.orchestra.run.gibba037.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh 2021-02-13T17:03:21.725 INFO:teuthology.orchestra.run.gibba037.stdout: ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc libjs-underscore 2021-02-13T17:03:21.725 INFO:teuthology.orchestra.run.gibba037.stdout: libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 libradosstriper1 2021-02-13T17:03:21.725 INFO:teuthology.orchestra.run.gibba037.stdout: librgw2 libsnappy1v5 libxslt1.1 nvme-cli python-attr python-bcrypt 2021-02-13T17:03:21.725 INFO:teuthology.orchestra.run.gibba037.stdout: python-bs4 python-ceph-argparse python-cephfs python-certifi python-chardet 2021-02-13T17:03:21.725 INFO:teuthology.orchestra.run.gibba037.stdout: python-cherrypy3 python-decorator python-dnspython python-fasteners 2021-02-13T17:03:21.726 INFO:teuthology.orchestra.run.gibba037.stdout: python-formencode python-funcsigs python-html5lib python-httplib2 2021-02-13T17:03:21.726 INFO:teuthology.orchestra.run.gibba037.stdout: python-joblib python-jwt python-kubernetes python-logutils python-lxml 2021-02-13T17:03:21.726 INFO:teuthology.orchestra.run.gibba037.stdout: python-mako python-markupsafe python-monotonic python-oauth2client 2021-02-13T17:03:21.726 INFO:teuthology.orchestra.run.gibba037.stdout: python-openid python-openssl python-paste python-pastedeploy 2021-02-13T17:03:21.726 INFO:teuthology.orchestra.run.gibba037.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-pluggy 2021-02-13T17:03:21.726 INFO:teuthology.orchestra.run.gibba037.stdout: python-prettytable python-py python-pyasn1 python-pyasn1-modules 2021-02-13T17:03:21.726 INFO:teuthology.orchestra.run.gibba037.stdout: python-pyinotify python-pytest python-rados python-rbd python-repoze.lru 2021-02-13T17:03:21.726 INFO:teuthology.orchestra.run.gibba037.stdout: python-requests python-rgw python-routes python-rsa python-scgi python-scipy 2021-02-13T17:03:21.726 INFO:teuthology.orchestra.run.gibba037.stdout: python-simplegeneric python-simplejson python-singledispatch python-sklearn 2021-02-13T17:03:21.726 INFO:teuthology.orchestra.run.gibba037.stdout: python-sklearn-lib python-sqlalchemy python-sqlalchemy-ext python-tempita 2021-02-13T17:03:21.726 INFO:teuthology.orchestra.run.gibba037.stdout: python-uritemplate python-urllib3 python-waitress python-webencodings 2021-02-13T17:03:21.726 INFO:teuthology.orchestra.run.gibba037.stdout: python-webob python-websocket python-webtest python-werkzeug python-yaml 2021-02-13T17:03:21.726 INFO:teuthology.orchestra.run.gibba037.stdout: socat xmlstarlet 2021-02-13T17:03:21.726 INFO:teuthology.orchestra.run.gibba037.stdout:Suggested packages: 2021-02-13T17:03:21.727 INFO:teuthology.orchestra.run.gibba037.stdout: python-influxdb python-attr-doc python-egenix-mxdatetime python-funcsigs-doc 2021-02-13T17:03:21.727 INFO:teuthology.orchestra.run.gibba037.stdout: python-genshi python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2021-02-13T17:03:21.727 INFO:teuthology.orchestra.run.gibba037.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2021-02-13T17:03:21.727 INFO:teuthology.orchestra.run.gibba037.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2021-02-13T17:03:21.727 INFO:teuthology.orchestra.run.gibba037.stdout: python-cherrypy python-flup python-pecan-doc subversion python-pytest-xdist 2021-02-13T17:03:21.727 INFO:teuthology.orchestra.run.gibba037.stdout: python-pyinotify-doc python-mock python-socks python-scipy-doc python-dap 2021-02-13T17:03:21.727 INFO:teuthology.orchestra.run.gibba037.stdout: python-scikits-optimization python-sklearn-doc ipython python-sqlalchemy-doc 2021-02-13T17:03:21.727 INFO:teuthology.orchestra.run.gibba037.stdout: python-psycopg2 python-pymysql python-fdb python-pymssql python-ntlm 2021-02-13T17:03:21.727 INFO:teuthology.orchestra.run.gibba037.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-pyquery 2021-02-13T17:03:21.727 INFO:teuthology.orchestra.run.gibba037.stdout: python-redis python-pylibmc | python-memcache python-termcolor 2021-02-13T17:03:21.727 INFO:teuthology.orchestra.run.gibba037.stdout: python-watchdog python-werkzeug-doc 2021-02-13T17:03:21.777 INFO:teuthology.orchestra.run.gibba037.stdout:The following NEW packages will be installed: 2021-02-13T17:03:21.777 INFO:teuthology.orchestra.run.gibba037.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-dashboard 2021-02-13T17:03:21.777 INFO:teuthology.orchestra.run.gibba037.stdout: ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local 2021-02-13T17:03:21.777 INFO:teuthology.orchestra.run.gibba037.stdout: ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh ceph-mon ceph-osd ceph-test 2021-02-13T17:03:21.777 INFO:teuthology.orchestra.run.gibba037.stdout: formencode-i18n jq libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc 2021-02-13T17:03:21.777 INFO:teuthology.orchestra.run.gibba037.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 2021-02-13T17:03:21.777 INFO:teuthology.orchestra.run.gibba037.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 nvme-cli python-attr 2021-02-13T17:03:21.777 INFO:teuthology.orchestra.run.gibba037.stdout: python-bcrypt python-bs4 python-ceph python-ceph-argparse python-cephfs 2021-02-13T17:03:21.777 INFO:teuthology.orchestra.run.gibba037.stdout: python-certifi python-chardet python-cherrypy3 python-decorator 2021-02-13T17:03:21.777 INFO:teuthology.orchestra.run.gibba037.stdout: python-dnspython python-fasteners python-formencode python-funcsigs 2021-02-13T17:03:21.777 INFO:teuthology.orchestra.run.gibba037.stdout: python-html5lib python-httplib2 python-joblib python-jwt python-kubernetes 2021-02-13T17:03:21.778 INFO:teuthology.orchestra.run.gibba037.stdout: python-logutils python-lxml python-mako python-markupsafe python-monotonic 2021-02-13T17:03:21.778 INFO:teuthology.orchestra.run.gibba037.stdout: python-oauth2client python-openid python-openssl python-paste 2021-02-13T17:03:21.778 INFO:teuthology.orchestra.run.gibba037.stdout: python-pastedeploy python-pastedeploy-tpl python-pastescript python-pecan 2021-02-13T17:03:21.778 INFO:teuthology.orchestra.run.gibba037.stdout: python-pluggy python-prettytable python-py python-pyasn1 2021-02-13T17:03:21.778 INFO:teuthology.orchestra.run.gibba037.stdout: python-pyasn1-modules python-pyinotify python-pytest python-rados python-rbd 2021-02-13T17:03:21.778 INFO:teuthology.orchestra.run.gibba037.stdout: python-repoze.lru python-requests python-rgw python-routes python-rsa 2021-02-13T17:03:21.778 INFO:teuthology.orchestra.run.gibba037.stdout: python-scgi python-scipy python-simplegeneric python-simplejson 2021-02-13T17:03:21.778 INFO:teuthology.orchestra.run.gibba037.stdout: python-singledispatch python-sklearn python-sklearn-lib python-sqlalchemy 2021-02-13T17:03:21.778 INFO:teuthology.orchestra.run.gibba037.stdout: python-sqlalchemy-ext python-tempita python-uritemplate python-urllib3 2021-02-13T17:03:21.778 INFO:teuthology.orchestra.run.gibba037.stdout: python-waitress python-webencodings python-webob python-websocket 2021-02-13T17:03:21.778 INFO:teuthology.orchestra.run.gibba037.stdout: python-webtest python-werkzeug python-yaml radosgw rbd-fuse socat xmlstarlet 2021-02-13T17:03:21.779 INFO:teuthology.orchestra.run.gibba037.stdout:The following packages will be upgraded: 2021-02-13T17:03:21.779 INFO:teuthology.orchestra.run.gibba037.stdout: librados2 librbd1 2021-02-13T17:03:21.849 INFO:teuthology.orchestra.run.gibba038.stdout:2 upgraded, 101 newly installed, 0 to remove and 78 not upgraded. 2021-02-13T17:03:21.849 INFO:teuthology.orchestra.run.gibba038.stdout:Need to get 109 MB of archives. 2021-02-13T17:03:21.849 INFO:teuthology.orchestra.run.gibba038.stdout:After this operation, 484 MB of additional disk space will be used. 2021-02-13T17:03:21.849 INFO:teuthology.orchestra.run.gibba038.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 14.2.16-285-g7194982c-1bionic [1,478 kB] 2021-02-13T17:03:21.888 INFO:teuthology.orchestra.run.gibba038.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-uritemplate all 0.6-1ubuntu1 [5,042 B] 2021-02-13T17:03:21.915 INFO:teuthology.orchestra.run.gibba037.stdout:2 upgraded, 101 newly installed, 0 to remove and 78 not upgraded. 2021-02-13T17:03:21.915 INFO:teuthology.orchestra.run.gibba037.stdout:Need to get 109 MB of archives. 2021-02-13T17:03:21.915 INFO:teuthology.orchestra.run.gibba037.stdout:After this operation, 484 MB of additional disk space will be used. 2021-02-13T17:03:21.915 INFO:teuthology.orchestra.run.gibba037.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 14.2.16-285-g7194982c-1bionic [1,478 kB] 2021-02-13T17:03:21.951 INFO:teuthology.orchestra.run.gibba037.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-uritemplate all 0.6-1ubuntu1 [5,042 B] 2021-02-13T17:03:21.970 INFO:teuthology.orchestra.run.gibba038.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-02-13T17:03:22.033 INFO:teuthology.orchestra.run.gibba037.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-02-13T17:03:22.047 INFO:teuthology.orchestra.run.gibba038.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 14.2.16-285-g7194982c-1bionic [3,018 kB] 2021-02-13T17:03:22.229 INFO:teuthology.orchestra.run.gibba038.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2021-02-13T17:03:22.240 INFO:teuthology.orchestra.run.gibba038.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-02-13T17:03:22.250 INFO:teuthology.orchestra.run.gibba038.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 14.2.16-285-g7194982c-1bionic [442 kB] 2021-02-13T17:03:22.260 INFO:teuthology.orchestra.run.gibba038.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-02-13T17:03:22.265 INFO:teuthology.orchestra.run.gibba037.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 14.2.16-285-g7194982c-1bionic [3,018 kB] 2021-02-13T17:03:22.266 INFO:teuthology.orchestra.run.gibba038.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-02-13T17:03:22.292 INFO:teuthology.orchestra.run.gibba038.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 14.2.16-285-g7194982c-1bionic [290 kB] 2021-02-13T17:03:22.303 INFO:teuthology.orchestra.run.gibba038.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse all 14.2.16-285-g7194982c-1bionic [20.2 kB] 2021-02-13T17:03:22.304 INFO:teuthology.orchestra.run.gibba038.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 14.2.16-285-g7194982c-1bionic [124 kB] 2021-02-13T17:03:22.317 INFO:teuthology.orchestra.run.gibba037.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2021-02-13T17:03:22.318 INFO:teuthology.orchestra.run.gibba037.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-02-13T17:03:22.320 INFO:teuthology.orchestra.run.gibba037.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-02-13T17:03:22.320 INFO:teuthology.orchestra.run.gibba037.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-02-13T17:03:22.322 INFO:teuthology.orchestra.run.gibba038.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-02-13T17:03:22.332 INFO:teuthology.orchestra.run.gibba038.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 14.2.16-285-g7194982c-1bionic [264 kB] 2021-02-13T17:03:22.334 INFO:teuthology.orchestra.run.gibba038.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2021-02-13T17:03:22.340 INFO:teuthology.orchestra.run.gibba038.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2021-02-13T17:03:22.341 INFO:teuthology.orchestra.run.gibba038.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 14.2.16-285-g7194982c-1bionic [4,303 kB] 2021-02-13T17:03:22.394 INFO:teuthology.orchestra.run.gibba038.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-jwt all 1.5.3+ds1-1 [15.8 kB] 2021-02-13T17:03:22.396 INFO:teuthology.orchestra.run.gibba038.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2021-02-13T17:03:22.403 INFO:teuthology.orchestra.run.gibba038.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2021-02-13T17:03:22.405 INFO:teuthology.orchestra.run.gibba038.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2021-02-13T17:03:22.406 INFO:teuthology.orchestra.run.gibba037.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-02-13T17:03:22.407 INFO:teuthology.orchestra.run.gibba038.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2021-02-13T17:03:22.415 INFO:teuthology.orchestra.run.gibba037.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2021-02-13T17:03:22.416 INFO:teuthology.orchestra.run.gibba038.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2021-02-13T17:03:22.422 INFO:teuthology.orchestra.run.gibba037.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2021-02-13T17:03:22.475 INFO:teuthology.orchestra.run.gibba038.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2021-02-13T17:03:22.476 INFO:teuthology.orchestra.run.gibba038.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2021-02-13T17:03:22.479 INFO:teuthology.orchestra.run.gibba037.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-jwt all 1.5.3+ds1-1 [15.8 kB] 2021-02-13T17:03:22.481 INFO:teuthology.orchestra.run.gibba037.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2021-02-13T17:03:22.482 INFO:teuthology.orchestra.run.gibba038.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-02-13T17:03:22.488 INFO:teuthology.orchestra.run.gibba038.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2021-02-13T17:03:22.489 INFO:teuthology.orchestra.run.gibba037.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2021-02-13T17:03:22.491 INFO:teuthology.orchestra.run.gibba037.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2021-02-13T17:03:22.494 INFO:teuthology.orchestra.run.gibba037.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2021-02-13T17:03:22.504 INFO:teuthology.orchestra.run.gibba037.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2021-02-13T17:03:22.556 INFO:teuthology.orchestra.run.gibba038.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2021-02-13T17:03:22.560 INFO:teuthology.orchestra.run.gibba038.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2021-02-13T17:03:22.565 INFO:teuthology.orchestra.run.gibba037.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2021-02-13T17:03:22.565 INFO:teuthology.orchestra.run.gibba037.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2021-02-13T17:03:22.567 INFO:teuthology.orchestra.run.gibba038.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2021-02-13T17:03:22.568 INFO:teuthology.orchestra.run.gibba038.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2021-02-13T17:03:22.571 INFO:teuthology.orchestra.run.gibba037.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-02-13T17:03:22.573 INFO:teuthology.orchestra.run.gibba038.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2021-02-13T17:03:22.575 INFO:teuthology.orchestra.run.gibba038.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-02-13T17:03:22.576 INFO:teuthology.orchestra.run.gibba037.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2021-02-13T17:03:22.581 INFO:teuthology.orchestra.run.gibba037.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2021-02-13T17:03:22.632 INFO:teuthology.orchestra.run.gibba038.stdout:Get:34 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 14.2.16-285-g7194982c-1bionic [98.9 kB] 2021-02-13T17:03:22.637 INFO:teuthology.orchestra.run.gibba038.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 14.2.16-285-g7194982c-1bionic [330 kB] 2021-02-13T17:03:22.646 INFO:teuthology.orchestra.run.gibba037.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2021-02-13T17:03:22.648 INFO:teuthology.orchestra.run.gibba038.stdout:Get:36 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 14.2.16-285-g7194982c-1bionic [15.5 MB] 2021-02-13T17:03:22.653 INFO:teuthology.orchestra.run.gibba037.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2021-02-13T17:03:22.653 INFO:teuthology.orchestra.run.gibba037.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2021-02-13T17:03:22.658 INFO:teuthology.orchestra.run.gibba037.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2021-02-13T17:03:22.659 INFO:teuthology.orchestra.run.gibba037.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-02-13T17:03:22.670 INFO:teuthology.orchestra.run.gibba038.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-02-13T17:03:22.670 INFO:teuthology.orchestra.run.gibba038.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2021-02-13T17:03:22.672 INFO:teuthology.orchestra.run.gibba038.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2021-02-13T17:03:22.674 INFO:teuthology.orchestra.run.gibba038.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2021-02-13T17:03:22.726 INFO:teuthology.orchestra.run.gibba037.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-02-13T17:03:22.727 INFO:teuthology.orchestra.run.gibba037.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2021-02-13T17:03:22.729 INFO:teuthology.orchestra.run.gibba037.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2021-02-13T17:03:22.731 INFO:teuthology.orchestra.run.gibba037.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2021-02-13T17:03:22.737 INFO:teuthology.orchestra.run.gibba037.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2021-02-13T17:03:22.752 INFO:teuthology.orchestra.run.gibba038.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2021-02-13T17:03:22.759 INFO:teuthology.orchestra.run.gibba038.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2021-02-13T17:03:22.762 INFO:teuthology.orchestra.run.gibba038.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.2 [86.0 kB] 2021-02-13T17:03:22.765 INFO:teuthology.orchestra.run.gibba038.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2021-02-13T17:03:22.768 INFO:teuthology.orchestra.run.gibba038.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-02-13T17:03:22.777 INFO:teuthology.orchestra.run.gibba038.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2021-02-13T17:03:22.792 INFO:teuthology.orchestra.run.gibba037.stdout:Get:33 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 14.2.16-285-g7194982c-1bionic [442 kB] 2021-02-13T17:03:22.806 INFO:teuthology.orchestra.run.gibba037.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2021-02-13T17:03:22.809 INFO:teuthology.orchestra.run.gibba037.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.2 [86.0 kB] 2021-02-13T17:03:22.813 INFO:teuthology.orchestra.run.gibba037.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2021-02-13T17:03:22.815 INFO:teuthology.orchestra.run.gibba037.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-02-13T17:03:22.824 INFO:teuthology.orchestra.run.gibba037.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2021-02-13T17:03:22.832 INFO:teuthology.orchestra.run.gibba038.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2021-02-13T17:03:22.835 INFO:teuthology.orchestra.run.gibba038.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2021-02-13T17:03:22.840 INFO:teuthology.orchestra.run.gibba038.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2021-02-13T17:03:22.842 INFO:teuthology.orchestra.run.gibba038.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-decorator all 4.1.2-1 [9,300 B] 2021-02-13T17:03:22.861 INFO:teuthology.orchestra.run.gibba037.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 14.2.16-285-g7194982c-1bionic [290 kB] 2021-02-13T17:03:22.872 INFO:teuthology.orchestra.run.gibba037.stdout:Get:40 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse all 14.2.16-285-g7194982c-1bionic [20.2 kB] 2021-02-13T17:03:22.873 INFO:teuthology.orchestra.run.gibba037.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 14.2.16-285-g7194982c-1bionic [124 kB] 2021-02-13T17:03:22.888 INFO:teuthology.orchestra.run.gibba037.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2021-02-13T17:03:22.890 INFO:teuthology.orchestra.run.gibba037.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2021-02-13T17:03:22.892 INFO:teuthology.orchestra.run.gibba037.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2021-02-13T17:03:22.897 INFO:teuthology.orchestra.run.gibba037.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-decorator all 4.1.2-1 [9,300 B] 2021-02-13T17:03:22.897 INFO:teuthology.orchestra.run.gibba037.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-scipy amd64 0.19.1-2ubuntu1 [9,689 kB] 2021-02-13T17:03:22.912 INFO:teuthology.orchestra.run.gibba038.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-scipy amd64 0.19.1-2ubuntu1 [9,689 kB] 2021-02-13T17:03:22.933 INFO:teuthology.orchestra.run.gibba037.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 14.2.16-285-g7194982c-1bionic [264 kB] 2021-02-13T17:03:22.942 INFO:teuthology.orchestra.run.gibba037.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 14.2.16-285-g7194982c-1bionic [4,303 kB] 2021-02-13T17:03:23.221 INFO:teuthology.orchestra.run.gibba037.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn-lib amd64 0.19.1-3 [1,521 kB] 2021-02-13T17:03:23.250 INFO:teuthology.orchestra.run.gibba038.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn-lib amd64 0.19.1-3 [1,521 kB] 2021-02-13T17:03:23.253 INFO:teuthology.orchestra.run.gibba037.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-joblib all 0.11-1 [112 kB] 2021-02-13T17:03:23.256 INFO:teuthology.orchestra.run.gibba037.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn all 0.19.1-3 [1,373 kB] 2021-02-13T17:03:23.276 INFO:teuthology.orchestra.run.gibba038.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-joblib all 0.11-1 [112 kB] 2021-02-13T17:03:23.277 INFO:teuthology.orchestra.run.gibba038.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn all 0.19.1-3 [1,373 kB] 2021-02-13T17:03:23.298 INFO:teuthology.orchestra.run.gibba037.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-monotonic all 1.1-2 [5,262 B] 2021-02-13T17:03:23.299 INFO:teuthology.orchestra.run.gibba037.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-fasteners all 0.12.0-3 [13.4 kB] 2021-02-13T17:03:23.300 INFO:teuthology.orchestra.run.gibba037.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [34.8 kB] 2021-02-13T17:03:23.302 INFO:teuthology.orchestra.run.gibba037.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1 all 0.4.2-3 [46.7 kB] 2021-02-13T17:03:23.304 INFO:teuthology.orchestra.run.gibba037.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1-modules all 0.2.1-0.2 [32.8 kB] 2021-02-13T17:03:23.306 INFO:teuthology.orchestra.run.gibba037.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-rsa all 3.4.2-1 [28.9 kB] 2021-02-13T17:03:23.307 INFO:teuthology.orchestra.run.gibba037.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy all 1.1.11+ds1-1ubuntu1 [682 kB] 2021-02-13T17:03:23.331 INFO:teuthology.orchestra.run.gibba038.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-monotonic all 1.1-2 [5,262 B] 2021-02-13T17:03:23.331 INFO:teuthology.orchestra.run.gibba038.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-fasteners all 0.12.0-3 [13.4 kB] 2021-02-13T17:03:23.331 INFO:teuthology.orchestra.run.gibba038.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [34.8 kB] 2021-02-13T17:03:23.332 INFO:teuthology.orchestra.run.gibba038.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1 all 0.4.2-3 [46.7 kB] 2021-02-13T17:03:23.332 INFO:teuthology.orchestra.run.gibba038.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1-modules all 0.2.1-0.2 [32.8 kB] 2021-02-13T17:03:23.333 INFO:teuthology.orchestra.run.gibba038.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-rsa all 3.4.2-1 [28.9 kB] 2021-02-13T17:03:23.333 INFO:teuthology.orchestra.run.gibba038.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy all 1.1.11+ds1-1ubuntu1 [682 kB] 2021-02-13T17:03:23.384 INFO:teuthology.orchestra.run.gibba037.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-oauth2client all 4.1.2-3 [61.4 kB] 2021-02-13T17:03:23.387 INFO:teuthology.orchestra.run.gibba037.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-02-13T17:03:23.389 INFO:teuthology.orchestra.run.gibba037.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-yaml amd64 3.12-1build2 [115 kB] 2021-02-13T17:03:23.393 INFO:teuthology.orchestra.run.gibba037.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-02-13T17:03:23.397 INFO:teuthology.orchestra.run.gibba037.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-02-13T17:03:23.413 INFO:teuthology.orchestra.run.gibba038.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-oauth2client all 4.1.2-3 [61.4 kB] 2021-02-13T17:03:23.414 INFO:teuthology.orchestra.run.gibba038.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-02-13T17:03:23.414 INFO:teuthology.orchestra.run.gibba038.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-yaml amd64 3.12-1build2 [115 kB] 2021-02-13T17:03:23.416 INFO:teuthology.orchestra.run.gibba038.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-02-13T17:03:23.418 INFO:teuthology.orchestra.run.gibba038.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-02-13T17:03:23.465 INFO:teuthology.orchestra.run.gibba037.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-02-13T17:03:23.469 INFO:teuthology.orchestra.run.gibba037.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-02-13T17:03:23.471 INFO:teuthology.orchestra.run.gibba037.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-02-13T17:03:23.483 INFO:teuthology.orchestra.run.gibba037.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-02-13T17:03:23.491 INFO:teuthology.orchestra.run.gibba037.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-02-13T17:03:23.494 INFO:teuthology.orchestra.run.gibba038.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-02-13T17:03:23.497 INFO:teuthology.orchestra.run.gibba038.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-02-13T17:03:23.499 INFO:teuthology.orchestra.run.gibba038.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-02-13T17:03:23.505 INFO:teuthology.orchestra.run.gibba038.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-02-13T17:03:23.509 INFO:teuthology.orchestra.run.gibba038.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-02-13T17:03:23.545 INFO:teuthology.orchestra.run.gibba037.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-02-13T17:03:23.554 INFO:teuthology.orchestra.run.gibba037.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-02-13T17:03:23.555 INFO:teuthology.orchestra.run.gibba037.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-02-13T17:03:23.556 INFO:teuthology.orchestra.run.gibba037.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2021-02-13T17:03:23.557 INFO:teuthology.orchestra.run.gibba037.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2021-02-13T17:03:23.575 INFO:teuthology.orchestra.run.gibba038.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-02-13T17:03:23.582 INFO:teuthology.orchestra.run.gibba038.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-02-13T17:03:23.583 INFO:teuthology.orchestra.run.gibba038.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-02-13T17:03:23.584 INFO:teuthology.orchestra.run.gibba038.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2021-02-13T17:03:23.585 INFO:teuthology.orchestra.run.gibba038.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2021-02-13T17:03:23.617 INFO:teuthology.orchestra.run.gibba038.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 14.2.16-285-g7194982c-1bionic [4,080 kB] 2021-02-13T17:03:23.626 INFO:teuthology.orchestra.run.gibba037.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.3 [899 kB] 2021-02-13T17:03:23.638 INFO:teuthology.orchestra.run.gibba037.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2021-02-13T17:03:23.639 INFO:teuthology.orchestra.run.gibba037.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2021-02-13T17:03:23.639 INFO:teuthology.orchestra.run.gibba037.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-02-13T17:03:23.639 INFO:teuthology.orchestra.run.gibba037.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-02-13T17:03:23.645 INFO:teuthology.orchestra.run.gibba037.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 14.2.16-285-g7194982c-1bionic [98.9 kB] 2021-02-13T17:03:23.648 INFO:teuthology.orchestra.run.gibba037.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 14.2.16-285-g7194982c-1bionic [330 kB] 2021-02-13T17:03:23.655 INFO:teuthology.orchestra.run.gibba038.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.3 [899 kB] 2021-02-13T17:03:23.666 INFO:teuthology.orchestra.run.gibba038.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2021-02-13T17:03:23.666 INFO:teuthology.orchestra.run.gibba038.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2021-02-13T17:03:23.667 INFO:teuthology.orchestra.run.gibba038.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-02-13T17:03:23.667 INFO:teuthology.orchestra.run.gibba038.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-02-13T17:03:23.706 INFO:teuthology.orchestra.run.gibba037.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2021-02-13T17:03:23.708 INFO:teuthology.orchestra.run.gibba037.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-02-13T17:03:23.711 INFO:teuthology.orchestra.run.gibba037.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2021-02-13T17:03:23.712 INFO:teuthology.orchestra.run.gibba037.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy-ext amd64 1.1.11+ds1-1ubuntu1 [13.4 kB] 2021-02-13T17:03:23.716 INFO:teuthology.orchestra.run.gibba037.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 14.2.16-285-g7194982c-1bionic [15.5 MB] 2021-02-13T17:03:23.736 INFO:teuthology.orchestra.run.gibba038.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2021-02-13T17:03:23.737 INFO:teuthology.orchestra.run.gibba038.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-02-13T17:03:23.741 INFO:teuthology.orchestra.run.gibba038.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2021-02-13T17:03:23.742 INFO:teuthology.orchestra.run.gibba038.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy-ext amd64 1.1.11+ds1-1ubuntu1 [13.4 kB] 2021-02-13T17:03:23.898 INFO:teuthology.orchestra.run.gibba038.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 14.2.16-285-g7194982c-1bionic [1,390 kB] 2021-02-13T17:03:23.974 INFO:teuthology.orchestra.run.gibba038.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 14.2.16-285-g7194982c-1bionic [3,230 kB] 2021-02-13T17:03:24.202 INFO:teuthology.orchestra.run.gibba038.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 14.2.16-285-g7194982c-1bionic [17.3 MB] 2021-02-13T17:03:25.449 INFO:teuthology.orchestra.run.gibba038.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 14.2.16-285-g7194982c-1bionic [3,980 B] 2021-02-13T17:03:25.449 INFO:teuthology.orchestra.run.gibba038.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 14.2.16-285-g7194982c-1bionic [528 kB] 2021-02-13T17:03:25.487 INFO:teuthology.orchestra.run.gibba038.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 14.2.16-285-g7194982c-1bionic [1,804 kB] 2021-02-13T17:03:25.613 INFO:teuthology.orchestra.run.gibba038.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 14.2.16-285-g7194982c-1bionic [3,455 kB] 2021-02-13T17:03:25.855 INFO:teuthology.orchestra.run.gibba038.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 14.2.16-285-g7194982c-1bionic [34.5 kB] 2021-02-13T17:03:25.856 INFO:teuthology.orchestra.run.gibba038.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 14.2.16-285-g7194982c-1bionic [1,093 kB] 2021-02-13T17:03:25.926 INFO:teuthology.orchestra.run.gibba038.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 14.2.16-285-g7194982c-1bionic [4,100 B] 2021-02-13T17:03:25.927 INFO:teuthology.orchestra.run.gibba038.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 14.2.16-285-g7194982c-1bionic [12.6 kB] 2021-02-13T17:03:25.927 INFO:teuthology.orchestra.run.gibba038.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-ssh all 14.2.16-285-g7194982c-1bionic [13.0 kB] 2021-02-13T17:03:25.928 INFO:teuthology.orchestra.run.gibba038.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 14.2.16-285-g7194982c-1bionic [26.1 MB] 2021-02-13T17:03:26.267 INFO:teuthology.orchestra.run.gibba037.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 14.2.16-285-g7194982c-1bionic [4,080 kB] 2021-02-13T17:03:26.971 INFO:teuthology.orchestra.run.gibba037.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 14.2.16-285-g7194982c-1bionic [1,390 kB] 2021-02-13T17:03:27.232 INFO:teuthology.orchestra.run.gibba037.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 14.2.16-285-g7194982c-1bionic [3,230 kB] 2021-02-13T17:03:27.858 INFO:teuthology.orchestra.run.gibba037.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 14.2.16-285-g7194982c-1bionic [17.3 MB] 2021-02-13T17:03:27.898 INFO:teuthology.orchestra.run.gibba038.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 14.2.16-285-g7194982c-1bionic [17.9 kB] 2021-02-13T17:03:27.899 INFO:teuthology.orchestra.run.gibba038.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph amd64 14.2.16-285-g7194982c-1bionic [4,040 B] 2021-02-13T17:03:27.900 INFO:teuthology.orchestra.run.gibba038.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 14.2.16-285-g7194982c-1bionic [4,905 kB] 2021-02-13T17:03:28.337 INFO:teuthology.orchestra.run.gibba038.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 14.2.16-285-g7194982c-1bionic [63.7 kB] 2021-02-13T17:03:28.736 INFO:teuthology.orchestra.run.gibba038.stdout:Fetched 109 MB in 7s (16.5 MB/s) 2021-02-13T17:03:28.885 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-uritemplate. 2021-02-13T17:03:28.907 INFO:teuthology.orchestra.run.gibba038.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137603 files and directories currently installed.) 2021-02-13T17:03:28.909 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../000-python-uritemplate_0.6-1ubuntu1_all.deb ... 2021-02-13T17:03:28.950 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-uritemplate (0.6-1ubuntu1) ... 2021-02-13T17:03:29.245 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-02-13T17:03:29.264 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../001-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-02-13T17:03:29.337 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-02-13T17:03:29.647 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../002-librbd1_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:29.765 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking librbd1 (14.2.16-285-g7194982c-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-02-13T17:03:30.238 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../003-librados2_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:30.361 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking librados2 (14.2.16-285-g7194982c-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-02-13T17:03:30.696 INFO:teuthology.orchestra.run.gibba037.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 14.2.16-285-g7194982c-1bionic [3,980 B] 2021-02-13T17:03:30.697 INFO:teuthology.orchestra.run.gibba037.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 14.2.16-285-g7194982c-1bionic [528 kB] 2021-02-13T17:03:30.757 INFO:teuthology.orchestra.run.gibba037.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 14.2.16-285-g7194982c-1bionic [1,804 kB] 2021-02-13T17:03:30.923 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libcephfs2. 2021-02-13T17:03:30.942 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../004-libcephfs2_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:30.952 INFO:teuthology.orchestra.run.gibba037.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 14.2.16-285-g7194982c-1bionic [3,455 kB] 2021-02-13T17:03:30.981 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libcephfs2 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:31.275 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-rados. 2021-02-13T17:03:31.282 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../005-python-rados_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:31.324 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-rados (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:31.336 INFO:teuthology.orchestra.run.gibba037.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 14.2.16-285-g7194982c-1bionic [34.5 kB] 2021-02-13T17:03:31.338 INFO:teuthology.orchestra.run.gibba037.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 14.2.16-285-g7194982c-1bionic [1,093 kB] 2021-02-13T17:03:31.473 INFO:teuthology.orchestra.run.gibba037.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 14.2.16-285-g7194982c-1bionic [4,100 B] 2021-02-13T17:03:31.474 INFO:teuthology.orchestra.run.gibba037.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 14.2.16-285-g7194982c-1bionic [12.6 kB] 2021-02-13T17:03:31.475 INFO:teuthology.orchestra.run.gibba037.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-ssh all 14.2.16-285-g7194982c-1bionic [13.0 kB] 2021-02-13T17:03:31.476 INFO:teuthology.orchestra.run.gibba037.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 14.2.16-285-g7194982c-1bionic [26.1 MB] 2021-02-13T17:03:31.611 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-ceph-argparse. 2021-02-13T17:03:31.630 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../006-python-ceph-argparse_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:03:31.668 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-ceph-argparse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:31.980 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-cephfs. 2021-02-13T17:03:31.986 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../007-python-cephfs_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:32.030 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-cephfs (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:32.291 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-prettytable. 2021-02-13T17:03:32.310 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../008-python-prettytable_0.7.2-3_all.deb ... 2021-02-13T17:03:32.349 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-prettytable (0.7.2-3) ... 2021-02-13T17:03:32.543 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-rbd. 2021-02-13T17:03:32.562 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../009-python-rbd_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:32.601 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-rbd (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:32.979 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-02-13T17:03:32.987 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../010-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-02-13T17:03:33.029 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-02-13T17:03:33.298 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package librgw2. 2021-02-13T17:03:33.318 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../011-librgw2_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:33.348 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking librgw2 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:33.761 INFO:teuthology.orchestra.run.gibba037.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 14.2.16-285-g7194982c-1bionic [17.9 kB] 2021-02-13T17:03:33.762 INFO:teuthology.orchestra.run.gibba037.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph amd64 14.2.16-285-g7194982c-1bionic [4,040 B] 2021-02-13T17:03:33.762 INFO:teuthology.orchestra.run.gibba037.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 14.2.16-285-g7194982c-1bionic [4,905 kB] 2021-02-13T17:03:33.834 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-rgw. 2021-02-13T17:03:33.840 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../012-python-rgw_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:33.875 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-rgw (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:34.161 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-02-13T17:03:34.180 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../013-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-02-13T17:03:34.213 INFO:teuthology.orchestra.run.gibba037.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 14.2.16-285-g7194982c-1bionic [63.7 kB] 2021-02-13T17:03:34.219 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-02-13T17:03:34.548 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-02-13T17:03:34.555 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../014-libleveldb1v5_1.20-2_amd64.deb ... 2021-02-13T17:03:34.597 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-02-13T17:03:34.697 INFO:teuthology.orchestra.run.gibba037.stdout:Fetched 109 MB in 12s (8,788 kB/s) 2021-02-13T17:03:34.750 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-uritemplate. 2021-02-13T17:03:34.811 INFO:teuthology.orchestra.run.gibba037.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137603 files and directories currently installed.) 2021-02-13T17:03:34.813 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../000-python-uritemplate_0.6-1ubuntu1_all.deb ... 2021-02-13T17:03:34.856 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-uritemplate (0.6-1ubuntu1) ... 2021-02-13T17:03:35.011 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package liboath0. 2021-02-13T17:03:35.030 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../015-liboath0_2.6.1-1_amd64.deb ... 2021-02-13T17:03:35.069 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-02-13T17:03:35.201 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-02-13T17:03:35.209 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../001-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-02-13T17:03:35.293 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-02-13T17:03:35.372 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libradosstriper1. 2021-02-13T17:03:35.379 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../016-libradosstriper1_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:35.422 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libradosstriper1 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:35.632 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../002-librbd1_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:35.746 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking librbd1 (14.2.16-285-g7194982c-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-02-13T17:03:35.783 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-common. 2021-02-13T17:03:35.802 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../017-ceph-common_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:35.833 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-common (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:36.194 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../003-librados2_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:36.317 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking librados2 (14.2.16-285-g7194982c-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-02-13T17:03:36.879 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libcephfs2. 2021-02-13T17:03:36.885 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../004-libcephfs2_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:36.928 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libcephfs2 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:37.097 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-base. 2021-02-13T17:03:37.116 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../018-ceph-base_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:37.168 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-base (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:37.197 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-rados. 2021-02-13T17:03:37.217 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../005-python-rados_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:37.256 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-rados (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:37.533 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-ceph-argparse. 2021-02-13T17:03:37.552 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../006-python-ceph-argparse_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:03:37.591 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-ceph-argparse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:37.893 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-bcrypt. 2021-02-13T17:03:37.903 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-cephfs. 2021-02-13T17:03:37.910 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../007-python-cephfs_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:37.912 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../019-python-bcrypt_3.1.4-2_amd64.deb ... 2021-02-13T17:03:37.951 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2021-02-13T17:03:37.952 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-cephfs (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:38.214 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-prettytable. 2021-02-13T17:03:38.228 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-cherrypy3. 2021-02-13T17:03:38.233 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../008-python-prettytable_0.7.2-3_all.deb ... 2021-02-13T17:03:38.236 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../020-python-cherrypy3_8.9.1-2_all.deb ... 2021-02-13T17:03:38.270 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2021-02-13T17:03:38.272 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-prettytable (0.7.2-3) ... 2021-02-13T17:03:38.499 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-rbd. 2021-02-13T17:03:38.518 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../009-python-rbd_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:38.557 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-rbd (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:38.574 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-jwt. 2021-02-13T17:03:38.593 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../021-python-jwt_1.5.3+ds1-1_all.deb ... 2021-02-13T17:03:38.632 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-jwt (1.5.3+ds1-1) ... 2021-02-13T17:03:38.926 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-02-13T17:03:38.933 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../010-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-02-13T17:03:38.960 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-openssl. 2021-02-13T17:03:38.965 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../022-python-openssl_17.5.0-1ubuntu1_all.deb ... 2021-02-13T17:03:38.976 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-02-13T17:03:39.009 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2021-02-13T17:03:39.271 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package librgw2. 2021-02-13T17:03:39.290 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../011-librgw2_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:39.321 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking librgw2 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:39.337 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-logutils. 2021-02-13T17:03:39.357 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../023-python-logutils_0.3.3-5_all.deb ... 2021-02-13T17:03:39.404 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-logutils (0.3.3-5) ... 2021-02-13T17:03:39.699 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-markupsafe. 2021-02-13T17:03:39.706 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../024-python-markupsafe_1.0-1build1_amd64.deb ... 2021-02-13T17:03:39.740 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2021-02-13T17:03:39.806 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-rgw. 2021-02-13T17:03:39.813 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../012-python-rgw_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:39.848 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-rgw (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:40.018 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-mako. 2021-02-13T17:03:40.037 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../025-python-mako_1.0.7+ds1-1_all.deb ... 2021-02-13T17:03:40.076 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2021-02-13T17:03:40.100 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-02-13T17:03:40.119 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../013-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-02-13T17:03:40.158 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-02-13T17:03:40.412 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-simplegeneric. 2021-02-13T17:03:40.418 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../026-python-simplegeneric_0.8.1-1_all.deb ... 2021-02-13T17:03:40.461 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2021-02-13T17:03:40.470 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-02-13T17:03:40.477 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../014-libleveldb1v5_1.20-2_amd64.deb ... 2021-02-13T17:03:40.520 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-02-13T17:03:40.789 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-singledispatch. 2021-02-13T17:03:40.809 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../027-python-singledispatch_3.4.0.3-2_all.deb ... 2021-02-13T17:03:40.816 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package liboath0. 2021-02-13T17:03:40.836 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../015-liboath0_2.6.1-1_amd64.deb ... 2021-02-13T17:03:40.856 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2021-02-13T17:03:40.875 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-02-13T17:03:41.161 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libradosstriper1. 2021-02-13T17:03:41.180 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../016-libradosstriper1_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:41.184 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-simplejson. 2021-02-13T17:03:41.190 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../028-python-simplejson_3.13.2-1_amd64.deb ... 2021-02-13T17:03:41.219 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libradosstriper1 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:41.234 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-simplejson (3.13.2-1) ... 2021-02-13T17:03:41.545 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-webob. 2021-02-13T17:03:41.564 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../029-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-02-13T17:03:41.603 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2021-02-13T17:03:41.631 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-common. 2021-02-13T17:03:41.638 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../017-ceph-common_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:41.680 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-common (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:41.906 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-bs4. 2021-02-13T17:03:41.925 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../030-python-bs4_4.6.0-1_all.deb ... 2021-02-13T17:03:41.964 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-bs4 (4.6.0-1) ... 2021-02-13T17:03:42.292 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-waitress. 2021-02-13T17:03:42.299 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../031-python-waitress_1.0.1-1_all.deb ... 2021-02-13T17:03:42.342 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-waitress (1.0.1-1) ... 2021-02-13T17:03:42.678 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-dnspython. 2021-02-13T17:03:42.698 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../032-python-dnspython_1.15.0-1_all.deb ... 2021-02-13T17:03:42.736 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-dnspython (1.15.0-1) ... 2021-02-13T17:03:42.869 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-base. 2021-02-13T17:03:42.889 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../018-ceph-base_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:42.940 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-base (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:43.014 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package formencode-i18n. 2021-02-13T17:03:43.033 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../033-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2021-02-13T17:03:43.072 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2021-02-13T17:03:43.374 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-formencode. 2021-02-13T17:03:43.381 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../034-python-formencode_1.3.0-0ubuntu5_all.deb ... 2021-02-13T17:03:43.424 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2021-02-13T17:03:43.657 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-bcrypt. 2021-02-13T17:03:43.663 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../019-python-bcrypt_3.1.4-2_amd64.deb ... 2021-02-13T17:03:43.698 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2021-02-13T17:03:43.736 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-tempita. 2021-02-13T17:03:43.755 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../035-python-tempita_0.5.2-2_all.deb ... 2021-02-13T17:03:43.794 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-tempita (0.5.2-2) ... 2021-02-13T17:03:44.034 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-cherrypy3. 2021-02-13T17:03:44.042 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../020-python-cherrypy3_8.9.1-2_all.deb ... 2021-02-13T17:03:44.084 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2021-02-13T17:03:44.122 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-paste. 2021-02-13T17:03:44.129 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../036-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-02-13T17:03:44.171 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2021-02-13T17:03:44.386 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-jwt. 2021-02-13T17:03:44.391 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../021-python-jwt_1.5.3+ds1-1_all.deb ... 2021-02-13T17:03:44.437 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-jwt (1.5.3+ds1-1) ... 2021-02-13T17:03:44.483 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-02-13T17:03:44.503 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../037-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-02-13T17:03:44.541 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-02-13T17:03:44.749 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-openssl. 2021-02-13T17:03:44.768 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../022-python-openssl_17.5.0-1ubuntu1_all.deb ... 2021-02-13T17:03:44.807 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2021-02-13T17:03:44.894 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-pastedeploy. 2021-02-13T17:03:44.901 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../038-python-pastedeploy_1.5.2-4_all.deb ... 2021-02-13T17:03:44.944 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2021-02-13T17:03:45.135 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-logutils. 2021-02-13T17:03:45.142 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../023-python-logutils_0.3.3-5_all.deb ... 2021-02-13T17:03:45.184 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-logutils (0.3.3-5) ... 2021-02-13T17:03:45.272 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-webtest. 2021-02-13T17:03:45.291 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../039-python-webtest_2.0.28-1ubuntu1_all.deb ... 2021-02-13T17:03:45.340 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2021-02-13T17:03:45.487 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-markupsafe. 2021-02-13T17:03:45.506 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../024-python-markupsafe_1.0-1build1_amd64.deb ... 2021-02-13T17:03:45.545 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2021-02-13T17:03:45.700 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-pecan. 2021-02-13T17:03:45.706 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../040-python-pecan_1.2.1-2_all.deb ... 2021-02-13T17:03:45.750 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-pecan (1.2.1-2) ... 2021-02-13T17:03:45.864 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-mako. 2021-02-13T17:03:45.871 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../025-python-mako_1.0.7+ds1-1_all.deb ... 2021-02-13T17:03:45.914 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2021-02-13T17:03:46.088 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-certifi. 2021-02-13T17:03:46.108 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../041-python-certifi_2018.1.18-2_all.deb ... 2021-02-13T17:03:46.146 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-certifi (2018.1.18-2) ... 2021-02-13T17:03:46.234 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-simplegeneric. 2021-02-13T17:03:46.254 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../026-python-simplegeneric_0.8.1-1_all.deb ... 2021-02-13T17:03:46.301 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2021-02-13T17:03:46.482 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-chardet. 2021-02-13T17:03:46.489 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../042-python-chardet_3.0.4-1_all.deb ... 2021-02-13T17:03:46.531 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-chardet (3.0.4-1) ... 2021-02-13T17:03:46.595 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-singledispatch. 2021-02-13T17:03:46.602 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../027-python-singledispatch_3.4.0.3-2_all.deb ... 2021-02-13T17:03:46.644 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2021-02-13T17:03:46.893 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-urllib3. 2021-02-13T17:03:46.913 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../043-python-urllib3_1.22-1ubuntu0.18.04.2_all.deb ... 2021-02-13T17:03:46.947 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-simplejson. 2021-02-13T17:03:46.952 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2021-02-13T17:03:46.966 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../028-python-simplejson_3.13.2-1_amd64.deb ... 2021-02-13T17:03:47.005 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-simplejson (3.13.2-1) ... 2021-02-13T17:03:47.280 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-requests. 2021-02-13T17:03:47.286 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../044-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2021-02-13T17:03:47.326 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-webob. 2021-02-13T17:03:47.329 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2021-02-13T17:03:47.331 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../029-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-02-13T17:03:47.367 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2021-02-13T17:03:47.649 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-werkzeug. 2021-02-13T17:03:47.669 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../045-python-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-02-13T17:03:47.686 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-bs4. 2021-02-13T17:03:47.706 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../030-python-bs4_4.6.0-1_all.deb ... 2021-02-13T17:03:47.715 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-02-13T17:03:47.753 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-bs4 (4.6.0-1) ... 2021-02-13T17:03:48.085 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr. 2021-02-13T17:03:48.088 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-waitress. 2021-02-13T17:03:48.091 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../046-ceph-mgr_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:48.095 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../031-python-waitress_1.0.1-1_all.deb ... 2021-02-13T17:03:48.134 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:48.138 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-waitress (1.0.1-1) ... 2021-02-13T17:03:48.466 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-dnspython. 2021-02-13T17:03:48.486 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../032-python-dnspython_1.15.0-1_all.deb ... 2021-02-13T17:03:48.533 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-dnspython (1.15.0-1) ... 2021-02-13T17:03:48.623 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mon. 2021-02-13T17:03:48.630 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../047-ceph-mon_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:48.673 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mon (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:48.803 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package formencode-i18n. 2021-02-13T17:03:48.822 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../033-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2021-02-13T17:03:48.869 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2021-02-13T17:03:49.214 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-formencode. 2021-02-13T17:03:49.219 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../034-python-formencode_1.3.0-0ubuntu5_all.deb ... 2021-02-13T17:03:49.254 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2021-02-13T17:03:49.309 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-osd. 2021-02-13T17:03:49.317 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../048-ceph-osd_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:49.359 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-osd (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:49.558 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-tempita. 2021-02-13T17:03:49.577 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../035-python-tempita_0.5.2-2_all.deb ... 2021-02-13T17:03:49.615 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-tempita (0.5.2-2) ... 2021-02-13T17:03:49.919 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-paste. 2021-02-13T17:03:49.927 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../036-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-02-13T17:03:49.968 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2021-02-13T17:03:50.255 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-02-13T17:03:50.274 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../037-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-02-13T17:03:50.313 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-02-13T17:03:50.539 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph. 2021-02-13T17:03:50.559 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../049-ceph_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:50.607 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-pastedeploy. 2021-02-13T17:03:50.614 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:50.627 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../038-python-pastedeploy_1.5.2-4_all.deb ... 2021-02-13T17:03:50.665 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2021-02-13T17:03:50.958 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-fuse. 2021-02-13T17:03:50.966 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../050-ceph-fuse_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:50.976 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-webtest. 2021-02-13T17:03:50.984 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../039-python-webtest_2.0.28-1ubuntu1_all.deb ... 2021-02-13T17:03:51.008 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-fuse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:51.027 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2021-02-13T17:03:51.370 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mds. 2021-02-13T17:03:51.389 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../051-ceph-mds_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:51.396 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-pecan. 2021-02-13T17:03:51.416 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../040-python-pecan_1.2.1-2_all.deb ... 2021-02-13T17:03:51.427 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mds (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:51.467 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-pecan (1.2.1-2) ... 2021-02-13T17:03:51.800 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-certifi. 2021-02-13T17:03:51.807 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../041-python-certifi_2018.1.18-2_all.deb ... 2021-02-13T17:03:51.850 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-certifi (2018.1.18-2) ... 2021-02-13T17:03:51.881 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-repoze.lru. 2021-02-13T17:03:51.889 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../052-python-repoze.lru_0.7-1_all.deb ... 2021-02-13T17:03:51.931 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-repoze.lru (0.7-1) ... 2021-02-13T17:03:52.184 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libjs-underscore. 2021-02-13T17:03:52.195 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-chardet. 2021-02-13T17:03:52.203 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../053-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2021-02-13T17:03:52.215 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../042-python-chardet_3.0.4-1_all.deb ... 2021-02-13T17:03:52.250 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2021-02-13T17:03:52.253 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-chardet (3.0.4-1) ... 2021-02-13T17:03:52.536 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-02-13T17:03:52.555 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../054-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2021-02-13T17:03:52.598 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-urllib3. 2021-02-13T17:03:52.606 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../043-python-urllib3_1.22-1ubuntu0.18.04.2_all.deb ... 2021-02-13T17:03:52.610 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2021-02-13T17:03:52.648 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2021-02-13T17:03:52.951 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-requests. 2021-02-13T17:03:52.970 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../044-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2021-02-13T17:03:52.980 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-routes. 2021-02-13T17:03:52.988 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../055-python-routes_2.4.1-1_all.deb ... 2021-02-13T17:03:53.009 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2021-02-13T17:03:53.030 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-routes (2.4.1-1) ... 2021-02-13T17:03:53.303 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-werkzeug. 2021-02-13T17:03:53.309 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../045-python-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-02-13T17:03:53.352 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-02-13T17:03:53.374 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-02-13T17:03:53.394 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:03:53.433 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr-dashboard (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:53.707 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-mgr. 2021-02-13T17:03:53.726 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../046-ceph-mgr_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:53.765 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-mgr (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:54.079 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-02-13T17:03:54.100 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../057-ceph-mgr-diskprediction-cloud_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:03:54.137 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr-diskprediction-cloud (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:54.252 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-mon. 2021-02-13T17:03:54.259 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../047-ceph-mon_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:54.302 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-mon (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:54.457 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-decorator. 2021-02-13T17:03:54.463 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../058-python-decorator_4.1.2-1_all.deb ... 2021-02-13T17:03:54.506 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-decorator (4.1.2-1) ... 2021-02-13T17:03:54.834 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-scipy. 2021-02-13T17:03:54.854 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../059-python-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-02-13T17:03:54.900 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-scipy (0.19.1-2ubuntu1) ... 2021-02-13T17:03:55.531 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-osd. 2021-02-13T17:03:55.551 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../048-ceph-osd_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:55.597 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-osd (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:56.401 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-sklearn-lib. 2021-02-13T17:03:56.422 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../060-python-sklearn-lib_0.19.1-3_amd64.deb ... 2021-02-13T17:03:56.459 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-sklearn-lib (0.19.1-3) ... 2021-02-13T17:03:56.768 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph. 2021-02-13T17:03:56.786 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../049-ceph_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:56.821 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-joblib. 2021-02-13T17:03:56.826 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:56.841 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../061-python-joblib_0.11-1_all.deb ... 2021-02-13T17:03:56.879 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-joblib (0.11-1) ... 2021-02-13T17:03:57.179 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-fuse. 2021-02-13T17:03:57.186 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../050-ceph-fuse_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:57.207 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-sklearn. 2021-02-13T17:03:57.214 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../062-python-sklearn_0.19.1-3_all.deb ... 2021-02-13T17:03:57.229 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-fuse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:57.248 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-sklearn (0.19.1-3) ... 2021-02-13T17:03:57.583 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-mds. 2021-02-13T17:03:57.602 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../051-ceph-mds_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:03:57.641 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-mds (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:57.704 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-02-13T17:03:57.725 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../063-ceph-mgr-diskprediction-local_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:03:57.762 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr-diskprediction-local (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:58.085 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-repoze.lru. 2021-02-13T17:03:58.093 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../052-python-repoze.lru_0.7-1_all.deb ... 2021-02-13T17:03:58.135 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-repoze.lru (0.7-1) ... 2021-02-13T17:03:58.325 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-monotonic. 2021-02-13T17:03:58.331 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../064-python-monotonic_1.1-2_all.deb ... 2021-02-13T17:03:58.374 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-monotonic (1.1-2) ... 2021-02-13T17:03:58.404 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libjs-underscore. 2021-02-13T17:03:58.424 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../053-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2021-02-13T17:03:58.462 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2021-02-13T17:03:58.702 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-fasteners. 2021-02-13T17:03:58.722 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../065-python-fasteners_0.12.0-3_all.deb ... 2021-02-13T17:03:58.757 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-02-13T17:03:58.768 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-fasteners (0.12.0-3) ... 2021-02-13T17:03:58.777 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../054-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2021-02-13T17:03:58.824 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2021-02-13T17:03:59.096 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-httplib2. 2021-02-13T17:03:59.103 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../066-python-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2021-02-13T17:03:59.126 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-routes. 2021-02-13T17:03:59.134 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../055-python-routes_2.4.1-1_all.deb ... 2021-02-13T17:03:59.137 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-02-13T17:03:59.176 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-routes (2.4.1-1) ... 2021-02-13T17:03:59.457 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-pyasn1. 2021-02-13T17:03:59.477 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../067-python-pyasn1_0.4.2-3_all.deb ... 2021-02-13T17:03:59.515 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-pyasn1 (0.4.2-3) ... 2021-02-13T17:03:59.520 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-02-13T17:03:59.540 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:03:59.587 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-mgr-dashboard (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:03:59.835 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-pyasn1-modules. 2021-02-13T17:03:59.843 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../068-python-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-02-13T17:03:59.885 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-pyasn1-modules (0.2.1-0.2) ... 2021-02-13T17:04:00.187 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-rsa. 2021-02-13T17:04:00.196 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../069-python-rsa_3.4.2-1_all.deb ... 2021-02-13T17:04:00.216 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-02-13T17:04:00.237 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../057-ceph-mgr-diskprediction-cloud_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:04:00.237 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-rsa (3.4.2-1) ... 2021-02-13T17:04:00.274 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-mgr-diskprediction-cloud (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:00.594 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-decorator. 2021-02-13T17:04:00.602 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../058-python-decorator_4.1.2-1_all.deb ... 2021-02-13T17:04:00.624 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-sqlalchemy. 2021-02-13T17:04:00.631 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../070-python-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-02-13T17:04:00.643 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-decorator (4.1.2-1) ... 2021-02-13T17:04:00.674 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-02-13T17:04:00.963 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-scipy. 2021-02-13T17:04:00.983 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../059-python-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-02-13T17:04:01.029 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-scipy (0.19.1-2ubuntu1) ... 2021-02-13T17:04:01.053 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-oauth2client. 2021-02-13T17:04:01.074 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../071-python-oauth2client_4.1.2-3_all.deb ... 2021-02-13T17:04:01.120 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-oauth2client (4.1.2-3) ... 2021-02-13T17:04:01.473 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-websocket. 2021-02-13T17:04:01.480 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../072-python-websocket_0.44.0-0ubuntu2_all.deb ... 2021-02-13T17:04:01.522 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-websocket (0.44.0-0ubuntu2) ... 2021-02-13T17:04:01.834 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-yaml. 2021-02-13T17:04:01.854 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../073-python-yaml_3.12-1build2_amd64.deb ... 2021-02-13T17:04:01.901 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-yaml (3.12-1build2) ... 2021-02-13T17:04:01.938 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-sklearn-lib. 2021-02-13T17:04:01.959 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../060-python-sklearn-lib_0.19.1-3_amd64.deb ... 2021-02-13T17:04:02.005 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-sklearn-lib (0.19.1-3) ... 2021-02-13T17:04:02.229 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-kubernetes. 2021-02-13T17:04:02.235 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../074-python-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-02-13T17:04:02.270 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-kubernetes (2.0.0-2ubuntu1) ... 2021-02-13T17:04:02.433 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-joblib. 2021-02-13T17:04:02.440 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../061-python-joblib_0.11-1_all.deb ... 2021-02-13T17:04:02.482 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-joblib (0.11-1) ... 2021-02-13T17:04:02.666 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-02-13T17:04:02.687 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../075-ceph-mgr-k8sevents_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:04:02.733 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr-k8sevents (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:02.811 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-sklearn. 2021-02-13T17:04:02.832 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../062-python-sklearn_0.19.1-3_all.deb ... 2021-02-13T17:04:02.878 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-sklearn (0.19.1-3) ... 2021-02-13T17:04:03.034 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-02-13T17:04:03.042 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../076-ceph-mgr-rook_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:04:03.084 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr-rook (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:03.358 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-02-13T17:04:03.379 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../063-ceph-mgr-diskprediction-local_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:04:03.396 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr-ssh. 2021-02-13T17:04:03.416 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../077-ceph-mgr-ssh_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:04:03.417 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-mgr-diskprediction-local (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:03.454 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr-ssh (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:03.790 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libonig4:amd64. 2021-02-13T17:04:03.797 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../078-libonig4_6.7.0-1_amd64.deb ... 2021-02-13T17:04:03.839 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-02-13T17:04:03.987 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-monotonic. 2021-02-13T17:04:04.008 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../064-python-monotonic_1.1-2_all.deb ... 2021-02-13T17:04:04.054 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-monotonic (1.1-2) ... 2021-02-13T17:04:04.193 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libjq1:amd64. 2021-02-13T17:04:04.213 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../079-libjq1_1.5+dfsg-2_amd64.deb ... 2021-02-13T17:04:04.259 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-02-13T17:04:04.331 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-fasteners. 2021-02-13T17:04:04.351 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../065-python-fasteners_0.12.0-3_all.deb ... 2021-02-13T17:04:04.389 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-fasteners (0.12.0-3) ... 2021-02-13T17:04:04.537 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package jq. 2021-02-13T17:04:04.545 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../080-jq_1.5+dfsg-2_amd64.deb ... 2021-02-13T17:04:04.639 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-02-13T17:04:04.908 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package socat. 2021-02-13T17:04:04.928 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../081-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-02-13T17:04:04.966 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-02-13T17:04:05.100 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-httplib2. 2021-02-13T17:04:05.108 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../066-python-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2021-02-13T17:04:05.150 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-02-13T17:04:05.319 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-02-13T17:04:05.326 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../082-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-02-13T17:04:05.369 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-02-13T17:04:05.461 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-pyasn1. 2021-02-13T17:04:05.482 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../067-python-pyasn1_0.4.2-3_all.deb ... 2021-02-13T17:04:05.929 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-pyasn1 (0.4.2-3) ... 2021-02-13T17:04:05.929 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-pyasn1-modules. 2021-02-13T17:04:05.929 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../068-python-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-02-13T17:04:05.929 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-pyasn1-modules (0.2.1-0.2) ... 2021-02-13T17:04:06.055 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package xmlstarlet. 2021-02-13T17:04:06.076 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../083-xmlstarlet_1.6.1-2_amd64.deb ... 2021-02-13T17:04:06.113 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-02-13T17:04:06.209 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-rsa. 2021-02-13T17:04:06.229 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../069-python-rsa_3.4.2-1_all.deb ... 2021-02-13T17:04:06.275 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-rsa (3.4.2-1) ... 2021-02-13T17:04:06.368 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-test. 2021-02-13T17:04:06.388 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../084-ceph-test_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:04:06.425 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-test (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:06.545 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-sqlalchemy. 2021-02-13T17:04:06.565 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../070-python-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-02-13T17:04:06.603 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-02-13T17:04:06.999 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-oauth2client. 2021-02-13T17:04:07.007 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../071-python-oauth2client_4.1.2-3_all.deb ... 2021-02-13T17:04:07.048 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-oauth2client (4.1.2-3) ... 2021-02-13T17:04:07.402 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-websocket. 2021-02-13T17:04:07.422 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../072-python-websocket_0.44.0-0ubuntu2_all.deb ... 2021-02-13T17:04:07.460 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-websocket (0.44.0-0ubuntu2) ... 2021-02-13T17:04:07.779 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-yaml. 2021-02-13T17:04:07.787 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../073-python-yaml_3.12-1build2_amd64.deb ... 2021-02-13T17:04:07.829 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-yaml (3.12-1build2) ... 2021-02-13T17:04:08.071 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libcephfs-dev. 2021-02-13T17:04:08.090 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../085-libcephfs-dev_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:04:08.129 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libcephfs-dev (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:08.158 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-kubernetes. 2021-02-13T17:04:08.178 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../074-python-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-02-13T17:04:08.224 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-kubernetes (2.0.0-2ubuntu1) ... 2021-02-13T17:04:08.390 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package nvme-cli. 2021-02-13T17:04:08.409 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../086-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-02-13T17:04:08.465 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-02-13T17:04:08.577 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-02-13T17:04:08.599 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../075-ceph-mgr-k8sevents_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:04:08.636 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-mgr-k8sevents (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:08.785 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-attr. 2021-02-13T17:04:08.791 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../087-python-attr_17.4.0-2_all.deb ... 2021-02-13T17:04:08.827 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-attr (17.4.0-2) ... 2021-02-13T17:04:08.946 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-02-13T17:04:08.953 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../076-ceph-mgr-rook_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:04:08.996 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-mgr-rook (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:09.063 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-ceph. 2021-02-13T17:04:09.084 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../088-python-ceph_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:04:09.121 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-ceph (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:09.299 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-mgr-ssh. 2021-02-13T17:04:09.320 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../077-ceph-mgr-ssh_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:04:09.366 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-mgr-ssh (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:09.382 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-funcsigs. 2021-02-13T17:04:09.403 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../089-python-funcsigs_1.0.2-4_all.deb ... 2021-02-13T17:04:09.440 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-02-13T17:04:09.727 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libonig4:amd64. 2021-02-13T17:04:09.735 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../078-libonig4_6.7.0-1_amd64.deb ... 2021-02-13T17:04:09.760 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-webencodings. 2021-02-13T17:04:09.766 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../090-python-webencodings_0.5-2_all.deb ... 2021-02-13T17:04:09.768 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-02-13T17:04:09.809 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-webencodings (0.5-2) ... 2021-02-13T17:04:10.096 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libjq1:amd64. 2021-02-13T17:04:10.112 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../079-libjq1_1.5+dfsg-2_amd64.deb ... 2021-02-13T17:04:10.129 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-html5lib. 2021-02-13T17:04:10.149 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../091-python-html5lib_0.999999999-1_all.deb ... 2021-02-13T17:04:10.154 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-02-13T17:04:10.195 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-html5lib (0.999999999-1) ... 2021-02-13T17:04:10.431 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package jq. 2021-02-13T17:04:10.438 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../080-jq_1.5+dfsg-2_amd64.deb ... 2021-02-13T17:04:10.559 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-02-13T17:04:10.565 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-lxml:amd64. 2021-02-13T17:04:10.573 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../092-python-lxml_4.2.1-1ubuntu0.3_amd64.deb ... 2021-02-13T17:04:10.615 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-02-13T17:04:10.811 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package socat. 2021-02-13T17:04:10.832 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../081-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-02-13T17:04:10.869 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-02-13T17:04:11.010 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-openid. 2021-02-13T17:04:11.031 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../093-python-openid_2.2.5-6_all.deb ... 2021-02-13T17:04:11.076 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-openid (2.2.5-6) ... 2021-02-13T17:04:11.239 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-02-13T17:04:11.247 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../082-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-02-13T17:04:11.288 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-02-13T17:04:11.413 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-pastescript. 2021-02-13T17:04:11.420 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../094-python-pastescript_2.0.2-2_all.deb ... 2021-02-13T17:04:11.462 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-pastescript (2.0.2-2) ... 2021-02-13T17:04:11.542 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package xmlstarlet. 2021-02-13T17:04:11.563 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../083-xmlstarlet_1.6.1-2_amd64.deb ... 2021-02-13T17:04:11.609 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-02-13T17:04:11.816 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-pluggy. 2021-02-13T17:04:11.838 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../095-python-pluggy_0.6.0-1_all.deb ... 2021-02-13T17:04:11.874 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-02-13T17:04:11.921 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package ceph-test. 2021-02-13T17:04:11.942 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../084-ceph-test_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:04:11.979 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking ceph-test (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:12.202 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-py. 2021-02-13T17:04:12.208 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../096-python-py_1.5.2-1_all.deb ... 2021-02-13T17:04:12.252 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-py (1.5.2-1) ... 2021-02-13T17:04:12.605 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-pyinotify. 2021-02-13T17:04:12.626 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../097-python-pyinotify_0.9.6-1_all.deb ... 2021-02-13T17:04:12.671 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2021-02-13T17:04:13.008 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-pytest. 2021-02-13T17:04:13.014 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../098-python-pytest_3.3.2-2_all.deb ... 2021-02-13T17:04:13.057 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-02-13T17:04:13.377 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-scgi. 2021-02-13T17:04:13.399 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../099-python-scgi_1.13-1.1build1_amd64.deb ... 2021-02-13T17:04:13.444 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2021-02-13T17:04:13.640 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package libcephfs-dev. 2021-02-13T17:04:13.659 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../085-libcephfs-dev_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:04:13.698 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking libcephfs-dev (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:13.721 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-sqlalchemy-ext. 2021-02-13T17:04:13.742 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../100-python-sqlalchemy-ext_1.1.11+ds1-1ubuntu1_amd64.deb ... 2021-02-13T17:04:13.788 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2021-02-13T17:04:13.960 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package nvme-cli. 2021-02-13T17:04:13.981 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../086-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-02-13T17:04:14.018 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-02-13T17:04:14.166 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package radosgw. 2021-02-13T17:04:14.174 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../101-radosgw_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:04:14.216 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking radosgw (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:14.339 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-attr. 2021-02-13T17:04:14.347 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../087-python-attr_17.4.0-2_all.deb ... 2021-02-13T17:04:14.388 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-attr (17.4.0-2) ... 2021-02-13T17:04:14.674 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-ceph. 2021-02-13T17:04:14.695 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../088-python-ceph_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:04:14.732 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-ceph (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:14.786 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package rbd-fuse. 2021-02-13T17:04:14.806 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../102-rbd-fuse_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:04:14.852 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking rbd-fuse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:15.044 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-funcsigs. 2021-02-13T17:04:15.051 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../089-python-funcsigs_1.0.2-4_all.deb ... 2021-02-13T17:04:15.085 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-02-13T17:04:15.149 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-dnspython (1.15.0-1) ... 2021-02-13T17:04:15.332 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-simplejson (3.13.2-1) ... 2021-02-13T17:04:15.338 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-webencodings. 2021-02-13T17:04:15.359 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../090-python-webencodings_0.5-2_all.deb ... 2021-02-13T17:04:15.396 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-webencodings (0.5-2) ... 2021-02-13T17:04:15.541 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-repoze.lru (0.7-1) ... 2021-02-13T17:04:15.657 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-html5lib. 2021-02-13T17:04:15.677 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../091-python-html5lib_0.999999999-1_all.deb ... 2021-02-13T17:04:15.715 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-html5lib (0.999999999-1) ... 2021-02-13T17:04:15.742 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-02-13T17:04:16.034 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-lxml:amd64. 2021-02-13T17:04:16.042 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../092-python-lxml_4.2.1-1ubuntu0.3_amd64.deb ... 2021-02-13T17:04:16.084 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-02-13T17:04:16.152 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-openid (2.2.5-6) ... 2021-02-13T17:04:16.337 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-prettytable (0.7.2-3) ... 2021-02-13T17:04:16.496 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-openid. 2021-02-13T17:04:16.517 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../093-python-openid_2.2.5-6_all.deb ... 2021-02-13T17:04:16.521 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2021-02-13T17:04:16.554 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-openid (2.2.5-6) ... 2021-02-13T17:04:16.739 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-yaml (3.12-1build2) ... 2021-02-13T17:04:16.891 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-pastescript. 2021-02-13T17:04:16.899 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../094-python-pastescript_2.0.2-2_all.deb ... 2021-02-13T17:04:16.933 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2021-02-13T17:04:16.940 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-pastescript (2.0.2-2) ... 2021-02-13T17:04:17.133 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-chardet (3.0.4-1) ... 2021-02-13T17:04:17.277 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-pluggy. 2021-02-13T17:04:17.298 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../095-python-pluggy_0.6.0-1_all.deb ... 2021-02-13T17:04:17.343 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-02-13T17:04:17.393 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-attr (17.4.0-2) ... 2021-02-13T17:04:17.594 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2021-02-13T17:04:17.655 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-py. 2021-02-13T17:04:17.676 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../096-python-py_1.5.2-1_all.deb ... 2021-02-13T17:04:17.720 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2021-02-13T17:04:17.721 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-py (1.5.2-1) ... 2021-02-13T17:04:17.896 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-02-13T17:04:18.022 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-pyasn1 (0.4.2-3) ... 2021-02-13T17:04:18.050 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-pyinotify. 2021-02-13T17:04:18.056 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../097-python-pyinotify_0.9.6-1_all.deb ... 2021-02-13T17:04:18.099 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2021-02-13T17:04:18.207 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-py (1.5.2-1) ... 2021-02-13T17:04:18.403 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-monotonic (1.1-2) ... 2021-02-13T17:04:18.418 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-pytest. 2021-02-13T17:04:18.439 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../098-python-pytest_3.3.2-2_all.deb ... 2021-02-13T17:04:18.477 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-02-13T17:04:18.601 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-joblib (0.11-1) ... 2021-02-13T17:04:18.823 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-scgi. 2021-02-13T17:04:18.830 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../099-python-scgi_1.13-1.1build1_amd64.deb ... 2021-02-13T17:04:18.844 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-02-13T17:04:18.872 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2021-02-13T17:04:18.970 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-02-13T17:04:19.138 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-certifi (2018.1.18-2) ... 2021-02-13T17:04:19.141 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package python-sqlalchemy-ext. 2021-02-13T17:04:19.162 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../100-python-sqlalchemy-ext_1.1.11+ds1-1ubuntu1_amd64.deb ... 2021-02-13T17:04:19.208 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2021-02-13T17:04:19.339 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2021-02-13T17:04:19.465 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2021-02-13T17:04:19.569 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package radosgw. 2021-02-13T17:04:19.574 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2021-02-13T17:04:19.576 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../101-radosgw_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:04:19.618 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking radosgw (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:19.751 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-ceph-argparse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:19.877 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-waitress (1.0.1-1) ... 2021-02-13T17:04:20.188 INFO:teuthology.orchestra.run.gibba037.stdout:Selecting previously unselected package rbd-fuse. 2021-02-13T17:04:20.195 INFO:teuthology.orchestra.run.gibba037.stdout:Preparing to unpack .../102-rbd-fuse_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:04:20.230 INFO:teuthology.orchestra.run.gibba038.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-02-13T17:04:20.237 INFO:teuthology.orchestra.run.gibba037.stdout:Unpacking rbd-fuse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:20.396 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-pyasn1-modules (0.2.1-0.2) ... 2021-02-13T17:04:20.552 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-dnspython (1.15.0-1) ... 2021-02-13T17:04:20.580 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-fasteners (0.12.0-3) ... 2021-02-13T17:04:20.784 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-simplejson (3.13.2-1) ... 2021-02-13T17:04:20.789 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-jwt (1.5.3+ds1-1) ... 2021-02-13T17:04:20.957 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-markupsafe (1.0-1build1) ... 2021-02-13T17:04:20.994 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-repoze.lru (0.7-1) ... 2021-02-13T17:04:21.150 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-02-13T17:04:21.161 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-02-13T17:04:21.351 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-pyinotify (0.9.6-1) ... 2021-02-13T17:04:21.555 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-openid (2.2.5-6) ... 2021-02-13T17:04:21.561 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-scgi (1.13-1.1build1) ... 2021-02-13T17:04:21.720 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-websocket (0.44.0-0ubuntu2) ... 2021-02-13T17:04:21.723 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-prettytable (0.7.2-3) ... 2021-02-13T17:04:21.811 INFO:teuthology.orchestra.run.gibba038.stdout:update-alternatives: using /usr/bin/python2-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-02-13T17:04:21.913 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-02-13T17:04:21.924 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2021-02-13T17:04:22.039 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-02-13T17:04:22.101 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-yaml (3.12-1build2) ... 2021-02-13T17:04:22.182 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-02-13T17:04:22.318 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2021-02-13T17:04:22.364 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-02-13T17:04:22.484 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-bs4 (4.6.0-1) ... 2021-02-13T17:04:22.519 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-chardet (3.0.4-1) ... 2021-02-13T17:04:22.702 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2021-02-13T17:04:22.770 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-attr (17.4.0-2) ... 2021-02-13T17:04:22.878 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-sklearn-lib (0.19.1-3) ... 2021-02-13T17:04:22.938 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2021-02-13T17:04:23.004 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-02-13T17:04:23.048 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2021-02-13T17:04:23.130 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-02-13T17:04:23.216 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-02-13T17:04:23.306 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2021-02-13T17:04:23.342 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-pyasn1 (0.4.2-3) ... 2021-02-13T17:04:23.432 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-02-13T17:04:23.559 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-py (1.5.2-1) ... 2021-02-13T17:04:23.600 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2021-02-13T17:04:23.767 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-uritemplate (0.6-1ubuntu1) ... 2021-02-13T17:04:23.785 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-monotonic (1.1-2) ... 2021-02-13T17:04:23.919 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-decorator (4.1.2-1) ... 2021-02-13T17:04:23.987 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-joblib (0.11-1) ... 2021-02-13T17:04:24.078 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up liboath0 (2.6.1-1) ... 2021-02-13T17:04:24.246 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-02-13T17:04:24.255 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2021-02-13T17:04:24.372 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-02-13T17:04:24.422 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-02-13T17:04:24.515 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-certifi (2018.1.18-2) ... 2021-02-13T17:04:24.548 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-02-13T17:04:24.674 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-tempita (0.5.2-2) ... 2021-02-13T17:04:24.716 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2021-02-13T17:04:24.842 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-02-13T17:04:24.843 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2021-02-13T17:04:24.951 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-webencodings (0.5-2) ... 2021-02-13T17:04:24.994 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2021-02-13T17:04:25.152 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2021-02-13T17:04:25.169 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-ceph-argparse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:25.295 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-waitress (1.0.1-1) ... 2021-02-13T17:04:25.354 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-bcrypt (3.1.4-2) ... 2021-02-13T17:04:25.513 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-logutils (0.3.3-5) ... 2021-02-13T17:04:25.714 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-routes (2.4.1-1) ... 2021-02-13T17:04:25.715 INFO:teuthology.orchestra.run.gibba037.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-02-13T17:04:25.856 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-pyasn1-modules (0.2.1-0.2) ... 2021-02-13T17:04:25.923 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2021-02-13T17:04:26.023 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-fasteners (0.12.0-3) ... 2021-02-13T17:04:26.133 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up jq (1.5+dfsg-2) ... 2021-02-13T17:04:26.234 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-jwt (1.5.3+ds1-1) ... 2021-02-13T17:04:26.234 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-scipy (0.19.1-2ubuntu1) ... 2021-02-13T17:04:26.435 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-markupsafe (1.0-1build1) ... 2021-02-13T17:04:26.644 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-02-13T17:04:26.887 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-pyinotify (0.9.6-1) ... 2021-02-13T17:04:26.972 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-rsa (3.4.2-1) ... 2021-02-13T17:04:27.096 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-scgi (1.13-1.1build1) ... 2021-02-13T17:04:27.139 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2021-02-13T17:04:27.264 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-websocket (0.44.0-0ubuntu2) ... 2021-02-13T17:04:27.355 INFO:teuthology.orchestra.run.gibba037.stdout:update-alternatives: using /usr/bin/python2-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-02-13T17:04:27.424 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-pytest (3.3.2-2) ... 2021-02-13T17:04:27.457 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-02-13T17:04:27.583 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-02-13T17:04:27.608 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-oauth2client (4.1.2-3) ... 2021-02-13T17:04:27.718 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-02-13T17:04:27.759 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-02-13T17:04:27.861 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-02-13T17:04:27.886 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-02-13T17:04:27.961 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up librados2 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:28.012 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-bs4 (4.6.0-1) ... 2021-02-13T17:04:28.088 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libcephfs2 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:28.196 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2021-02-13T17:04:28.214 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-sklearn (0.19.1-3) ... 2021-02-13T17:04:28.414 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-sklearn-lib (0.19.1-3) ... 2021-02-13T17:04:28.540 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-02-13T17:04:28.649 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-02-13T17:04:28.741 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libcephfs-dev (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:28.825 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2021-02-13T17:04:28.843 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-kubernetes (2.0.0-2ubuntu1) ... 2021-02-13T17:04:28.951 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-02-13T17:04:29.152 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2021-02-13T17:04:29.219 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-html5lib (0.999999999-1) ... 2021-02-13T17:04:29.320 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-uritemplate (0.6-1ubuntu1) ... 2021-02-13T17:04:29.396 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-rados (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:29.480 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-decorator (4.1.2-1) ... 2021-02-13T17:04:29.522 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-cephfs (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:29.680 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up liboath0 (2.6.1-1) ... 2021-02-13T17:04:29.723 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libradosstriper1 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:29.849 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up librgw2 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:29.857 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2021-02-13T17:04:29.975 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-rgw (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:30.041 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-02-13T17:04:30.076 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2021-02-13T17:04:30.150 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-02-13T17:04:30.218 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-fuse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:30.276 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-tempita (0.5.2-2) ... 2021-02-13T17:04:30.377 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-02-13T17:04:30.377 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-02-13T17:04:30.436 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-02-13T17:04:30.562 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-webencodings (0.5-2) ... 2021-02-13T17:04:30.586 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up librbd1 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:30.687 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-pastescript (2.0.2-2) ... 2021-02-13T17:04:30.721 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2021-02-13T17:04:30.847 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-rbd (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:30.964 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-bcrypt (3.1.4-2) ... 2021-02-13T17:04:31.049 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-common (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:31.124 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-logutils (0.3.3-5) ... 2021-02-13T17:04:31.333 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-routes (2.4.1-1) ... 2021-02-13T17:04:31.471 INFO:teuthology.orchestra.run.gibba038.stdout:Adding group ceph....done 2021-02-13T17:04:31.492 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2021-02-13T17:04:31.668 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up jq (1.5+dfsg-2) ... 2021-02-13T17:04:31.783 INFO:teuthology.orchestra.run.gibba038.stdout:Adding system user ceph....done 2021-02-13T17:04:31.794 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-scipy (0.19.1-2ubuntu1) ... 2021-02-13T17:04:31.959 INFO:teuthology.orchestra.run.gibba038.stdout:Setting system user ceph properties....done 2021-02-13T17:04:32.036 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-02-13T17:04:32.172 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-02-13T17:04:32.376 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up radosgw (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:32.545 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-02-13T17:04:32.545 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-02-13T17:04:32.549 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-rsa (3.4.2-1) ... 2021-02-13T17:04:32.716 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2021-02-13T17:04:32.819 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up rbd-fuse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:32.920 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-ceph (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:32.935 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-pytest (3.3.2-2) ... 2021-02-13T17:04:33.021 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2021-02-13T17:04:33.177 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-oauth2client (4.1.2-3) ... 2021-02-13T17:04:33.180 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-test (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:33.307 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-base (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:33.353 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-02-13T17:04:33.480 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-02-13T17:04:33.530 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-02-13T17:04:33.606 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up librados2 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:33.717 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-pecan (1.2.1-2) ... 2021-02-13T17:04:33.732 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libcephfs2 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:33.808 INFO:teuthology.orchestra.run.gibba038.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-02-13T17:04:33.831 INFO:teuthology.orchestra.run.gibba038.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-02-13T17:04:33.858 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-sklearn (0.19.1-3) ... 2021-02-13T17:04:33.961 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-osd (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:34.344 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-02-13T17:04:34.344 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-02-13T17:04:34.386 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libcephfs-dev (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:34.512 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-kubernetes (2.0.0-2ubuntu1) ... 2021-02-13T17:04:34.547 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mds (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:34.747 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-02-13T17:04:34.747 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-02-13T17:04:34.906 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-html5lib (0.999999999-1) ... 2021-02-13T17:04:34.948 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mon (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:35.104 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-02-13T17:04:35.105 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-02-13T17:04:35.157 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-rados (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:35.284 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-cephfs (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:35.308 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:35.451 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up libradosstriper1 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:35.470 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-02-13T17:04:35.470 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-02-13T17:04:35.560 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up librgw2 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:35.660 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr-diskprediction-local (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:35.802 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr-diskprediction-cloud (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:35.915 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr-rook (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:36.028 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:36.095 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-rgw (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:36.130 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr-k8sevents (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:36.221 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2021-02-13T17:04:36.230 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr-ssh (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:36.381 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr-dashboard (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:36.721 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-fuse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:36.722 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-02-13T17:04:36.722 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-02-13T17:04:36.748 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up librbd1 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:36.874 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-pastescript (2.0.2-2) ... 2021-02-13T17:04:36.975 INFO:teuthology.orchestra.run.gibba038.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.3) ... 2021-02-13T17:04:37.059 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-rbd (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:37.111 INFO:teuthology.orchestra.run.gibba038.stdout:Processing triggers for systemd (237-3ubuntu10.42) ... 2021-02-13T17:04:37.261 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-common (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:37.277 INFO:teuthology.orchestra.run.gibba038.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-02-13T17:04:37.773 INFO:teuthology.orchestra.run.gibba037.stdout:Adding group ceph....done 2021-02-13T17:04:38.133 INFO:teuthology.orchestra.run.gibba037.stdout:Adding system user ceph....done 2021-02-13T17:04:38.300 INFO:teuthology.orchestra.run.gibba037.stdout:Setting system user ceph properties....done 2021-02-13T17:04:38.382 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-02-13T17:04:38.480 INFO:teuthology.orchestra.run.gibba038.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-02-13T17:04:38.515 INFO:teuthology.orchestra.run.gibba038.stdout:ureadahead will be reprofiled on next reboot 2021-02-13T17:04:38.523 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-02-13T17:04:38.721 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up radosgw (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:38.802 INFO:teuthology.orchestra.run.gibba038.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-02-13T17:04:38.803 DEBUG:teuthology.parallel:result is None 2021-02-13T17:04:38.968 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-02-13T17:04:38.968 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-02-13T17:04:39.256 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up rbd-fuse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:39.382 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-ceph (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:39.509 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2021-02-13T17:04:39.676 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-test (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:39.794 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-base (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:40.000 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-02-13T17:04:40.187 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up python-pecan (1.2.1-2) ... 2021-02-13T17:04:40.304 INFO:teuthology.orchestra.run.gibba037.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-02-13T17:04:40.327 INFO:teuthology.orchestra.run.gibba037.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-02-13T17:04:40.456 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-osd (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:40.870 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-02-13T17:04:40.871 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-02-13T17:04:41.068 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-mds (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:41.265 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-02-13T17:04:41.266 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-02-13T17:04:41.452 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-mon (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:41.590 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-02-13T17:04:41.591 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-02-13T17:04:41.787 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-mgr (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:41.978 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-02-13T17:04:41.978 INFO:teuthology.orchestra.run.gibba037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-02-13T17:04:42.180 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-mgr-diskprediction-local (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:42.331 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-mgr-diskprediction-cloud (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:42.465 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-mgr-rook (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:42.599 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:42.725 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-mgr-k8sevents (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:42.852 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-mgr-ssh (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:42.994 INFO:teuthology.orchestra.run.gibba037.stdout:Setting up ceph-mgr-dashboard (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:04:43.112 INFO:teuthology.orchestra.run.gibba037.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.3) ... 2021-02-13T17:04:43.249 INFO:teuthology.orchestra.run.gibba037.stdout:Processing triggers for systemd (237-3ubuntu10.42) ... 2021-02-13T17:04:43.406 INFO:teuthology.orchestra.run.gibba037.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-02-13T17:04:44.459 INFO:teuthology.orchestra.run.gibba037.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-02-13T17:04:44.502 INFO:teuthology.orchestra.run.gibba037.stdout:ureadahead will be reprofiled on next reboot 2021-02-13T17:04:44.782 INFO:teuthology.orchestra.run.gibba037.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-02-13T17:04:44.783 DEBUG:teuthology.parallel:result is None 2021-02-13T17:04:44.783 DEBUG:teuthology.orchestra.run.gibba037:> sudo lsb_release -is 2021-02-13T17:04:44.851 INFO:teuthology.orchestra.run.gibba037.stdout:Ubuntu 2021-02-13T17:04:44.854 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-13T17:04:44.855 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=7194982cc16a1fd51df59ee58e1c54797c4465d1 2021-02-13T17:04:45.018 DEBUG:teuthology.orchestra.run.gibba037:> dpkg-query -W -f '${Version}' ceph 2021-02-13T17:04:45.033 INFO:teuthology.orchestra.run.gibba037.stdout:14.2.16-285-g7194982c-1bionic 2021-02-13T17:04:45.034 INFO:teuthology.packaging:The installed version of ceph is 14.2.16-285-g7194982c-1bionic 2021-02-13T17:04:45.034 INFO:teuthology.task.install:The correct ceph version 14.2.16-285-g7194982c-1bionic is installed. 2021-02-13T17:04:45.034 DEBUG:teuthology.orchestra.run.gibba038:> sudo lsb_release -is 2021-02-13T17:04:45.063 INFO:teuthology.orchestra.run.gibba038.stdout:Ubuntu 2021-02-13T17:04:45.065 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-13T17:04:45.065 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=7194982cc16a1fd51df59ee58e1c54797c4465d1 2021-02-13T17:04:45.224 DEBUG:teuthology.orchestra.run.gibba038:> dpkg-query -W -f '${Version}' ceph 2021-02-13T17:04:45.269 INFO:teuthology.orchestra.run.gibba038.stdout:14.2.16-285-g7194982c-1bionic 2021-02-13T17:04:45.270 INFO:teuthology.packaging:The installed version of ceph is 14.2.16-285-g7194982c-1bionic 2021-02-13T17:04:45.270 INFO:teuthology.task.install:The correct ceph version 14.2.16-285-g7194982c-1bionic is installed. 2021-02-13T17:04:45.270 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-02-13T17:04:45.270 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-02-13T17:04:45.270 DEBUG:teuthology.orchestra.run.gibba037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-02-13T17:04:45.288 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-02-13T17:04:45.288 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-02-13T17:04:45.331 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-02-13T17:04:45.331 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-02-13T17:04:45.331 DEBUG:teuthology.orchestra.run.gibba037:> sudo dd of=/usr/bin/daemon-helper 2021-02-13T17:04:45.341 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-02-13T17:04:45.389 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-02-13T17:04:45.390 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/usr/bin/daemon-helper 2021-02-13T17:04:45.410 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-02-13T17:04:45.472 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-02-13T17:04:45.472 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-02-13T17:04:45.473 DEBUG:teuthology.orchestra.run.gibba037:> sudo dd of=/usr/bin/adjust-ulimits 2021-02-13T17:04:45.493 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-02-13T17:04:45.556 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-02-13T17:04:45.557 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/usr/bin/adjust-ulimits 2021-02-13T17:04:45.568 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-02-13T17:04:45.616 INFO:teuthology.run_tasks:Running task ceph... 2021-02-13T17:04:45.668 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-02-13T17:04:45.668 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 777 /var/log/ceph 2021-02-13T17:04:45.671 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 777 /var/log/ceph 2021-02-13T17:04:45.687 INFO:tasks.ceph:Disabling ceph logrotate... 2021-02-13T17:04:45.687 DEBUG:teuthology.orchestra.run.gibba037:> sudo rm -f -- /etc/logrotate.d/ceph 2021-02-13T17:04:45.732 DEBUG:teuthology.orchestra.run.gibba038:> sudo rm -f -- /etc/logrotate.d/ceph 2021-02-13T17:04:45.748 INFO:tasks.ceph:Creating extra log directories... 2021-02-13T17:04:45.748 DEBUG:teuthology.orchestra.run.gibba037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-02-13T17:04:45.792 DEBUG:teuthology.orchestra.run.gibba038:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-02-13T17:04:45.809 INFO:tasks.ceph:Creating ceph cluster c1... 2021-02-13T17:04:45.809 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'c1', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-02-13T17:04:45.810 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877897', 'branch': 'wip-yuri3-testing-2021-02-12-0757-nautilus', 'description': 'rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '5877897', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'gibba', 'name': 'yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba', 'nuke-on-error': True, 'os_type': 'ubuntu', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2021-02-12-0757-nautilus'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1', 'wait-for-scrub': False}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1'}}, 'rgw': {'compression type': 'random', 'frontend': 'beast'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}, {'endpoints': ['c1.client.1'], 'name': 'test-zone3'}, {'endpoints': ['c2.client.1'], 'is_pubsub': True, 'name': 'test-zone4'}]}]}, 'workunit': {'branch': 'wip-yuri3-testing-2021-02-12-0757-nautilus', 'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'], ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']], 'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-yuri3-testing-2021-02-12-0757-nautilus', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1', 'targets': {'gibba037.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzABDCsGE9yRhAkC6g75qKS7gUEu8hpPCM5R4uj5uToKOrjI8K+TxzOqQwnmxD84g3IltOBDEnv8a06qFbeI0GYvItL3MELTesE9s8aVAgkhmzSn7wYdnRH8EY+sIRY2RHWDzrK8OxKN0d1XR1fjPsoh2fbZ2saFRLt12+//zy6AsVghxQxC1d0CAeCqUQvHgKwMQaR+3fTuszGC6SUqbgwUvtB2tz8c4o5B+GbBd8FIS/IbEGIdYd4GhPRVrNLz8fAGO5ghtdgP41/RFxNxRsLqojliWWAu+tVbS12Ba+/wUPjdo0iRk+l87KEhFgP8+MMX0zcc4S5pwrzy1iaplL', 'gibba038.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDD7VwUSrYdHXOl4pmIZcvEij6kXTpMa6hWNCa/64cQ49FwHErn3O5fxtxDVgAv9Bj+bFPArBTvEu/YPwrNeMK+siR3jG85n4JW0Xi5loAw1FgI8jV246kTf6qjxIfd3kRbVfSzMm6EY2LZAJlwe66czjKkYWoVVKUSS5S3IUPlxWCzZDP9hNpbVN9IgI6NQ/E/C8EHVp69+e+k+TYC5Wh64OutsMswwGml3X8tFu+M8NIJYePKC7k5OTix4+GQWiiY89ckU7mjpLVLC3kwPciVPf5wDck04ZJwwmpZwi+Mqp4d81o8RhbVjbVFpmGDdIZHOLa2fRQfm3hSSjgFJrVh'}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1', 'wait-for-scrub': False}}, {'ceph': {'cluster': 'c2'}}, {'rgw': {'c1.client.0': {'port': 8000}, 'c1.client.1': {'port': 8001}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 60}}}], 'teuthology_branch': 'master', 'teuthology_sha1': '87d40f79d7da6caf6da06c190938773bf745140c', 'timestamp': '2021-02-12_17:45:41', 'tube': 'gibba', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.gibba.29737'} 2021-02-13T17:04:45.810 DEBUG:teuthology.orchestra.run.gibba037:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2021-02-13T17:04:45.856 DEBUG:teuthology.orchestra.run.gibba038:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2021-02-13T17:04:45.861 DEBUG:teuthology.orchestra.run.gibba037:> sudo install -d -m0777 -- /var/run/ceph 2021-02-13T17:04:45.907 DEBUG:teuthology.orchestra.run.gibba038:> sudo install -d -m0777 -- /var/run/ceph 2021-02-13T17:04:45.927 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-02-13T17:04:45.928 DEBUG:teuthology.orchestra.run.gibba037:> dd if=/scratch_devs of=/dev/stdout 2021-02-13T17:04:45.961 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-02-13T17:04:45.961 DEBUG:teuthology.orchestra.run.gibba037:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-02-13T17:04:46.014 INFO:teuthology.orchestra.run.gibba037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-02-13T17:04:46.014 INFO:teuthology.orchestra.run.gibba037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-13T17:04:46.014 INFO:teuthology.orchestra.run.gibba037.stdout:Device: 6h/6d Inode: 334 Links: 1 2021-02-13T17:04:46.014 INFO:teuthology.orchestra.run.gibba037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-13T17:04:46.015 INFO:teuthology.orchestra.run.gibba037.stdout:Access: 2021-02-13 17:02:34.823968776 +0000 2021-02-13T17:04:46.015 INFO:teuthology.orchestra.run.gibba037.stdout:Modify: 2021-02-13 17:02:34.747968777 +0000 2021-02-13T17:04:46.015 INFO:teuthology.orchestra.run.gibba037.stdout:Change: 2021-02-13 17:02:34.747968777 +0000 2021-02-13T17:04:46.015 INFO:teuthology.orchestra.run.gibba037.stdout: Birth: - 2021-02-13T17:04:46.021 INFO:teuthology.orchestra.run.gibba037.stderr:1+0 records in 2021-02-13T17:04:46.021 INFO:teuthology.orchestra.run.gibba037.stderr:1+0 records out 2021-02-13T17:04:46.021 INFO:teuthology.orchestra.run.gibba037.stderr:512 bytes copied, 0.000192418 s, 2.7 MB/s 2021-02-13T17:04:46.023 DEBUG:teuthology.orchestra.run.gibba037:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-02-13T17:04:46.069 INFO:teuthology.orchestra.run.gibba037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-02-13T17:04:46.069 INFO:teuthology.orchestra.run.gibba037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-13T17:04:46.069 INFO:teuthology.orchestra.run.gibba037.stdout:Device: 6h/6d Inode: 340 Links: 1 2021-02-13T17:04:46.069 INFO:teuthology.orchestra.run.gibba037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-13T17:04:46.069 INFO:teuthology.orchestra.run.gibba037.stdout:Access: 2021-02-13 17:02:34.987968774 +0000 2021-02-13T17:04:46.069 INFO:teuthology.orchestra.run.gibba037.stdout:Modify: 2021-02-13 17:02:34.895968775 +0000 2021-02-13T17:04:46.070 INFO:teuthology.orchestra.run.gibba037.stdout:Change: 2021-02-13 17:02:34.895968775 +0000 2021-02-13T17:04:46.070 INFO:teuthology.orchestra.run.gibba037.stdout: Birth: - 2021-02-13T17:04:46.073 INFO:teuthology.orchestra.run.gibba037.stderr:1+0 records in 2021-02-13T17:04:46.073 INFO:teuthology.orchestra.run.gibba037.stderr:1+0 records out 2021-02-13T17:04:46.073 INFO:teuthology.orchestra.run.gibba037.stderr:512 bytes copied, 0.000195265 s, 2.6 MB/s 2021-02-13T17:04:46.075 DEBUG:teuthology.orchestra.run.gibba037:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-02-13T17:04:46.126 INFO:teuthology.orchestra.run.gibba037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-02-13T17:04:46.126 INFO:teuthology.orchestra.run.gibba037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-13T17:04:46.126 INFO:teuthology.orchestra.run.gibba037.stdout:Device: 6h/6d Inode: 346 Links: 1 2021-02-13T17:04:46.126 INFO:teuthology.orchestra.run.gibba037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-13T17:04:46.126 INFO:teuthology.orchestra.run.gibba037.stdout:Access: 2021-02-13 17:02:35.083968774 +0000 2021-02-13T17:04:46.127 INFO:teuthology.orchestra.run.gibba037.stdout:Modify: 2021-02-13 17:02:35.079968774 +0000 2021-02-13T17:04:46.127 INFO:teuthology.orchestra.run.gibba037.stdout:Change: 2021-02-13 17:02:35.079968774 +0000 2021-02-13T17:04:46.127 INFO:teuthology.orchestra.run.gibba037.stdout: Birth: - 2021-02-13T17:04:46.138 INFO:teuthology.orchestra.run.gibba037.stderr:1+0 records in 2021-02-13T17:04:46.138 INFO:teuthology.orchestra.run.gibba037.stderr:1+0 records out 2021-02-13T17:04:46.139 INFO:teuthology.orchestra.run.gibba037.stderr:512 bytes copied, 0.000464889 s, 1.1 MB/s 2021-02-13T17:04:46.144 DEBUG:teuthology.orchestra.run.gibba037:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-02-13T17:04:46.194 INFO:teuthology.orchestra.run.gibba037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-02-13T17:04:46.194 INFO:teuthology.orchestra.run.gibba037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-13T17:04:46.194 INFO:teuthology.orchestra.run.gibba037.stdout:Device: 6h/6d Inode: 352 Links: 1 2021-02-13T17:04:46.194 INFO:teuthology.orchestra.run.gibba037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-13T17:04:46.195 INFO:teuthology.orchestra.run.gibba037.stdout:Access: 2021-02-13 17:02:35.343968771 +0000 2021-02-13T17:04:46.195 INFO:teuthology.orchestra.run.gibba037.stdout:Modify: 2021-02-13 17:02:35.267968772 +0000 2021-02-13T17:04:46.195 INFO:teuthology.orchestra.run.gibba037.stdout:Change: 2021-02-13 17:02:35.267968772 +0000 2021-02-13T17:04:46.195 INFO:teuthology.orchestra.run.gibba037.stdout: Birth: - 2021-02-13T17:04:46.201 INFO:teuthology.orchestra.run.gibba037.stderr:1+0 records in 2021-02-13T17:04:46.201 INFO:teuthology.orchestra.run.gibba037.stderr:1+0 records out 2021-02-13T17:04:46.201 INFO:teuthology.orchestra.run.gibba037.stderr:512 bytes copied, 0.000162795 s, 3.1 MB/s 2021-02-13T17:04:46.202 INFO:tasks.ceph:osd dev map: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-02-13T17:04:46.203 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@gibba037.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}} 2021-02-13T17:04:46.203 INFO:tasks.ceph:Generating config... 2021-02-13T17:04:46.204 INFO:tasks.ceph:[client] debug rgw = 20 2021-02-13T17:04:46.204 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2021-02-13T17:04:46.205 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-02-13T17:04:46.205 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2021-02-13T17:04:46.205 INFO:tasks.ceph:[client] rgw data log num shards = 4 2021-02-13T17:04:46.205 INFO:tasks.ceph:[client] rgw md log max shards = 4 2021-02-13T17:04:46.205 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2021-02-13T17:04:46.205 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2021-02-13T17:04:46.205 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2021-02-13T17:04:46.205 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-02-13T17:04:46.205 INFO:tasks.ceph:[mgr] debug ms = 1 2021-02-13T17:04:46.205 INFO:tasks.ceph:[mon] debug mon = 20 2021-02-13T17:04:46.205 INFO:tasks.ceph:[mon] debug ms = 1 2021-02-13T17:04:46.205 INFO:tasks.ceph:[mon] debug paxos = 20 2021-02-13T17:04:46.206 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2021-02-13T17:04:46.206 INFO:tasks.ceph:[osd] debug filestore = 20 2021-02-13T17:04:46.206 INFO:tasks.ceph:[osd] debug journal = 20 2021-02-13T17:04:46.206 INFO:tasks.ceph:[osd] debug ms = 20 2021-02-13T17:04:46.206 INFO:tasks.ceph:[osd] debug osd = 25 2021-02-13T17:04:46.206 INFO:tasks.ceph:[osd] osd fast shutdown = False 2021-02-13T17:04:46.206 INFO:tasks.ceph:[osd.0] osd_max_omap_entries_per_request = 10 2021-02-13T17:04:46.206 INFO:tasks.ceph:[osd.1] osd_max_omap_entries_per_request = 1000 2021-02-13T17:04:46.206 INFO:tasks.ceph:[osd.2] osd_max_omap_entries_per_request = 10000 2021-02-13T17:04:46.207 INFO:tasks.ceph:Setting up c1.mon.a... 2021-02-13T17:04:46.207 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c1.keyring 2021-02-13T17:04:46.282 INFO:teuthology.orchestra.run.gibba037.stdout:creating /etc/ceph/c1.keyring 2021-02-13T17:04:46.284 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c1.keyring 2021-02-13T17:04:46.343 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-02-13T17:04:46.392 DEBUG:tasks.ceph:Ceph mon addresses: [('c1.mon.a', '172.21.2.137')] 2021-02-13T17:04:46.392 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.2.137 --print /home/ubuntu/cephtest/c1.monmap 2021-02-13T17:04:46.486 INFO:teuthology.orchestra.run.gibba037.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c1.monmap 2021-02-13T17:04:46.486 INFO:teuthology.orchestra.run.gibba037.stdout:monmaptool: generated fsid 611a710d-9f14-45ea-aab7-0ffef279fb6a 2021-02-13T17:04:46.486 INFO:teuthology.orchestra.run.gibba037.stdout:epoch 0 2021-02-13T17:04:46.486 INFO:teuthology.orchestra.run.gibba037.stdout:fsid 611a710d-9f14-45ea-aab7-0ffef279fb6a 2021-02-13T17:04:46.486 INFO:teuthology.orchestra.run.gibba037.stdout:last_changed 2021-02-13 17:04:46.484089 2021-02-13T17:04:46.487 INFO:teuthology.orchestra.run.gibba037.stdout:created 2021-02-13 17:04:46.484089 2021-02-13T17:04:46.488 INFO:teuthology.orchestra.run.gibba037.stdout:min_mon_release 0 (unknown) 2021-02-13T17:04:46.488 INFO:teuthology.orchestra.run.gibba037.stdout:0: [v2:172.21.2.137:3300/0,v1:172.21.2.137:6789/0] mon.a 2021-02-13T17:04:46.488 INFO:teuthology.orchestra.run.gibba037.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c1.monmap (1 monitors) 2021-02-13T17:04:46.489 INFO:tasks.ceph:Writing /etc/ceph/c1.conf for FSID 611a710d-9f14-45ea-aab7-0ffef279fb6a... 2021-02-13T17:04:46.490 DEBUG:teuthology.orchestra.run.gibba037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2021-02-13T17:04:46.492 DEBUG:teuthology.orchestra.run.gibba038:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2021-02-13T17:04:46.503 INFO:teuthology.orchestra.run.gibba037.stdout:[global] 2021-02-13T17:04:46.503 INFO:teuthology.orchestra.run.gibba037.stdout: chdir = "" 2021-02-13T17:04:46.503 INFO:teuthology.orchestra.run.gibba037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-13T17:04:46.503 INFO:teuthology.orchestra.run.gibba037.stdout: auth supported = cephx 2021-02-13T17:04:46.503 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.503 INFO:teuthology.orchestra.run.gibba037.stdout: filestore xattr use omap = true 2021-02-13T17:04:46.503 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.503 INFO:teuthology.orchestra.run.gibba037.stdout: mon clock drift allowed = 1.000 2021-02-13T17:04:46.503 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.503 INFO:teuthology.orchestra.run.gibba037.stdout: osd crush chooseleaf type = 0 2021-02-13T17:04:46.503 INFO:teuthology.orchestra.run.gibba037.stdout: auth debug = true 2021-02-13T17:04:46.503 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.504 INFO:teuthology.orchestra.run.gibba037.stdout: ms die on old message = true 2021-02-13T17:04:46.504 INFO:teuthology.orchestra.run.gibba037.stdout: ms die on bug = true 2021-02-13T17:04:46.504 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.504 INFO:teuthology.orchestra.run.gibba037.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-13T17:04:46.504 INFO:teuthology.orchestra.run.gibba037.stdout: mon pg warn max object skew = 0 2021-02-13T17:04:46.504 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.504 INFO:teuthology.orchestra.run.gibba037.stdout: osd pool default size = 2 2021-02-13T17:04:46.504 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.504 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd allow primary affinity = true 2021-02-13T17:04:46.504 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd allow pg remap = true 2021-02-13T17:04:46.504 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on legacy crush tunables = false 2021-02-13T17:04:46.504 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on crush straw calc version zero = false 2021-02-13T17:04:46.504 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on no sortbitwise = false 2021-02-13T17:04:46.504 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on osd down out interval zero = false 2021-02-13T17:04:46.505 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on too few osds = false 2021-02-13T17:04:46.505 INFO:teuthology.orchestra.run.gibba037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-13T17:04:46.505 INFO:teuthology.orchestra.run.gibba037.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-13T17:04:46.505 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.505 INFO:teuthology.orchestra.run.gibba037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-13T17:04:46.505 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.505 INFO:teuthology.orchestra.run.gibba037.stdout: osd default data pool replay window = 5 2021-02-13T17:04:46.505 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.505 INFO:teuthology.orchestra.run.gibba037.stdout: mon allow pool delete = true 2021-02-13T17:04:46.505 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.505 INFO:teuthology.orchestra.run.gibba037.stdout: mon cluster log file level = debug 2021-02-13T17:04:46.505 INFO:teuthology.orchestra.run.gibba037.stdout: debug asserts on shutdown = true 2021-02-13T17:04:46.505 INFO:teuthology.orchestra.run.gibba037.stdout: mon health detail to clog = false 2021-02-13T17:04:46.505 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.506 INFO:teuthology.orchestra.run.gibba037.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-02-13T17:04:46.506 INFO:teuthology.orchestra.run.gibba037.stdout: mon_client_directed_command_retry = 4 2021-02-13T17:04:46.506 INFO:teuthology.orchestra.run.gibba037.stdout: mon host = 172.21.2.137 2021-02-13T17:04:46.506 INFO:teuthology.orchestra.run.gibba037.stdout: osd heartbeat grace = 40 2021-02-13T17:04:46.506 INFO:teuthology.orchestra.run.gibba037.stdout: fsid = 611a710d-9f14-45ea-aab7-0ffef279fb6a 2021-02-13T17:04:46.506 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.506 INFO:teuthology.orchestra.run.gibba037.stdout:[osd] 2021-02-13T17:04:46.506 INFO:teuthology.orchestra.run.gibba037.stdout: osd journal size = 100 2021-02-13T17:04:46.506 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.506 INFO:teuthology.orchestra.run.gibba037.stdout: osd scrub load threshold = 5.0 2021-02-13T17:04:46.506 INFO:teuthology.orchestra.run.gibba037.stdout: osd scrub max interval = 600 2021-02-13T17:04:46.506 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.506 INFO:teuthology.orchestra.run.gibba037.stdout: osd recover clone overlap = true 2021-02-13T17:04:46.507 INFO:teuthology.orchestra.run.gibba037.stdout: osd recovery max chunk = 1048576 2021-02-13T17:04:46.507 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.507 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug shutdown = true 2021-02-13T17:04:46.507 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug op order = true 2021-02-13T17:04:46.507 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug verify stray on activate = true 2021-02-13T17:04:46.507 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.507 INFO:teuthology.orchestra.run.gibba037.stdout: osd open classes on start = true 2021-02-13T17:04:46.507 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug pg log writeout = true 2021-02-13T17:04:46.507 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.507 INFO:teuthology.orchestra.run.gibba037.stdout: osd deep scrub update digest min age = 30 2021-02-13T17:04:46.507 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.507 INFO:teuthology.orchestra.run.gibba037.stdout: osd map max advance = 10 2021-02-13T17:04:46.507 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.507 INFO:teuthology.orchestra.run.gibba037.stdout: journal zero on create = true 2021-02-13T17:04:46.508 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.508 INFO:teuthology.orchestra.run.gibba037.stdout: filestore ondisk finisher threads = 3 2021-02-13T17:04:46.508 INFO:teuthology.orchestra.run.gibba037.stdout: filestore apply finisher threads = 3 2021-02-13T17:04:46.508 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.508 INFO:teuthology.orchestra.run.gibba037.stdout: bdev debug aio = true 2021-02-13T17:04:46.508 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug misdirected ops = true 2021-02-13T17:04:46.508 INFO:teuthology.orchestra.run.gibba037.stdout: debug filestore = 20 2021-02-13T17:04:46.508 INFO:teuthology.orchestra.run.gibba037.stdout: debug journal = 20 2021-02-13T17:04:46.508 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 20 2021-02-13T17:04:46.508 INFO:teuthology.orchestra.run.gibba037.stdout: debug osd = 25 2021-02-13T17:04:46.509 INFO:teuthology.orchestra.run.gibba037.stdout: osd fast shutdown = False 2021-02-13T17:04:46.509 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.509 INFO:teuthology.orchestra.run.gibba037.stdout:[mgr] 2021-02-13T17:04:46.509 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 1 2021-02-13T17:04:46.509 INFO:teuthology.orchestra.run.gibba037.stdout: debug mgr = 20 2021-02-13T17:04:46.509 INFO:teuthology.orchestra.run.gibba037.stdout: debug mon = 20 2021-02-13T17:04:46.509 INFO:teuthology.orchestra.run.gibba037.stdout: debug auth = 20 2021-02-13T17:04:46.509 INFO:teuthology.orchestra.run.gibba037.stdout: mon reweight min pgs per osd = 4 2021-02-13T17:04:46.509 INFO:teuthology.orchestra.run.gibba037.stdout: mon reweight min bytes per osd = 10 2021-02-13T17:04:46.509 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.509 INFO:teuthology.orchestra.run.gibba037.stdout:[mon] 2021-02-13T17:04:46.509 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 1 2021-02-13T17:04:46.509 INFO:teuthology.orchestra.run.gibba037.stdout: debug mon = 20 2021-02-13T17:04:46.509 INFO:teuthology.orchestra.run.gibba037.stdout: debug paxos = 20 2021-02-13T17:04:46.510 INFO:teuthology.orchestra.run.gibba037.stdout: debug auth = 20 2021-02-13T17:04:46.510 INFO:teuthology.orchestra.run.gibba037.stdout: mon data avail warn = 5 2021-02-13T17:04:46.510 INFO:teuthology.orchestra.run.gibba037.stdout: mon mgr mkfs grace = 240 2021-02-13T17:04:46.510 INFO:teuthology.orchestra.run.gibba037.stdout: mon reweight min pgs per osd = 4 2021-02-13T17:04:46.510 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd reporter subtree level = osd 2021-02-13T17:04:46.510 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd prime pg temp = true 2021-02-13T17:04:46.510 INFO:teuthology.orchestra.run.gibba037.stdout: mon reweight min bytes per osd = 10 2021-02-13T17:04:46.510 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd crush smoke test = False 2021-02-13T17:04:46.510 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:04:46.510 INFO:teuthology.orchestra.run.gibba037.stdout:[client] 2021-02-13T17:04:46.510 INFO:teuthology.orchestra.run.gibba037.stdout: rgw cache enabled = true 2021-02-13T17:04:46.510 INFO:teuthology.orchestra.run.gibba037.stdout: rgw enable ops log = true 2021-02-13T17:04:46.510 INFO:teuthology.orchestra.run.gibba037.stdout: rgw enable usage log = true 2021-02-13T17:04:46.510 INFO:teuthology.orchestra.run.gibba037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-13T17:04:46.511 INFO:teuthology.orchestra.run.gibba037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-13T17:04:46.511 INFO:teuthology.orchestra.run.gibba037.stdout: debug rgw = 20 2021-02-13T17:04:46.511 INFO:teuthology.orchestra.run.gibba037.stdout: rgw crypt require ssl = False 2021-02-13T17:04:46.511 INFO:teuthology.orchestra.run.gibba037.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-02-13T17:04:46.511 INFO:teuthology.orchestra.run.gibba037.stdout: rgw curl low speed time = 300 2021-02-13T17:04:46.511 INFO:teuthology.orchestra.run.gibba037.stdout: rgw data log num shards = 4 2021-02-13T17:04:46.511 INFO:teuthology.orchestra.run.gibba037.stdout: rgw md log max shards = 4 2021-02-13T17:04:46.511 INFO:teuthology.orchestra.run.gibba037.stdout: rgw sync log trim interval = 0 2021-02-13T17:04:46.511 INFO:teuthology.orchestra.run.gibba037.stdout: rgw sync obj etag verify = True 2021-02-13T17:04:46.511 INFO:teuthology.orchestra.run.gibba037.stdout:[mon.a] 2021-02-13T17:04:46.511 INFO:teuthology.orchestra.run.gibba037.stdout:[osd.0] 2021-02-13T17:04:46.511 INFO:teuthology.orchestra.run.gibba037.stdout: osd_max_omap_entries_per_request = 10 2021-02-13T17:04:46.511 INFO:teuthology.orchestra.run.gibba037.stdout:[osd.1] 2021-02-13T17:04:46.512 INFO:teuthology.orchestra.run.gibba037.stdout: osd_max_omap_entries_per_request = 1000 2021-02-13T17:04:46.512 INFO:teuthology.orchestra.run.gibba037.stdout:[osd.2] 2021-02-13T17:04:46.512 INFO:teuthology.orchestra.run.gibba037.stdout: osd_max_omap_entries_per_request = 10000 2021-02-13T17:04:46.513 INFO:teuthology.orchestra.run.gibba038.stdout:[global] 2021-02-13T17:04:46.513 INFO:teuthology.orchestra.run.gibba038.stdout: chdir = "" 2021-02-13T17:04:46.513 INFO:teuthology.orchestra.run.gibba038.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-13T17:04:46.513 INFO:teuthology.orchestra.run.gibba038.stdout: auth supported = cephx 2021-02-13T17:04:46.513 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.513 INFO:teuthology.orchestra.run.gibba038.stdout: filestore xattr use omap = true 2021-02-13T17:04:46.513 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.513 INFO:teuthology.orchestra.run.gibba038.stdout: mon clock drift allowed = 1.000 2021-02-13T17:04:46.513 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.513 INFO:teuthology.orchestra.run.gibba038.stdout: osd crush chooseleaf type = 0 2021-02-13T17:04:46.514 INFO:teuthology.orchestra.run.gibba038.stdout: auth debug = true 2021-02-13T17:04:46.514 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.514 INFO:teuthology.orchestra.run.gibba038.stdout: ms die on old message = true 2021-02-13T17:04:46.514 INFO:teuthology.orchestra.run.gibba038.stdout: ms die on bug = true 2021-02-13T17:04:46.514 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.514 INFO:teuthology.orchestra.run.gibba038.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-13T17:04:46.514 INFO:teuthology.orchestra.run.gibba038.stdout: mon pg warn max object skew = 0 2021-02-13T17:04:46.514 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.514 INFO:teuthology.orchestra.run.gibba038.stdout: osd pool default size = 2 2021-02-13T17:04:46.514 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.514 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd allow primary affinity = true 2021-02-13T17:04:46.514 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd allow pg remap = true 2021-02-13T17:04:46.514 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on legacy crush tunables = false 2021-02-13T17:04:46.515 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on crush straw calc version zero = false 2021-02-13T17:04:46.515 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on no sortbitwise = false 2021-02-13T17:04:46.515 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on osd down out interval zero = false 2021-02-13T17:04:46.515 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on too few osds = false 2021-02-13T17:04:46.515 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-13T17:04:46.515 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-13T17:04:46.515 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.515 INFO:teuthology.orchestra.run.gibba038.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-13T17:04:46.515 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.515 INFO:teuthology.orchestra.run.gibba038.stdout: osd default data pool replay window = 5 2021-02-13T17:04:46.515 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.515 INFO:teuthology.orchestra.run.gibba038.stdout: mon allow pool delete = true 2021-02-13T17:04:46.515 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.515 INFO:teuthology.orchestra.run.gibba038.stdout: mon cluster log file level = debug 2021-02-13T17:04:46.515 INFO:teuthology.orchestra.run.gibba038.stdout: debug asserts on shutdown = true 2021-02-13T17:04:46.516 INFO:teuthology.orchestra.run.gibba038.stdout: mon health detail to clog = false 2021-02-13T17:04:46.516 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.516 INFO:teuthology.orchestra.run.gibba038.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-02-13T17:04:46.516 INFO:teuthology.orchestra.run.gibba038.stdout: mon_client_directed_command_retry = 4 2021-02-13T17:04:46.516 INFO:teuthology.orchestra.run.gibba038.stdout: mon host = 172.21.2.137 2021-02-13T17:04:46.516 INFO:teuthology.orchestra.run.gibba038.stdout: osd heartbeat grace = 40 2021-02-13T17:04:46.516 INFO:teuthology.orchestra.run.gibba038.stdout: fsid = 611a710d-9f14-45ea-aab7-0ffef279fb6a 2021-02-13T17:04:46.516 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.516 INFO:teuthology.orchestra.run.gibba038.stdout:[osd] 2021-02-13T17:04:46.516 INFO:teuthology.orchestra.run.gibba038.stdout: osd journal size = 100 2021-02-13T17:04:46.517 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.517 INFO:teuthology.orchestra.run.gibba038.stdout: osd scrub load threshold = 5.0 2021-02-13T17:04:46.517 INFO:teuthology.orchestra.run.gibba038.stdout: osd scrub max interval = 600 2021-02-13T17:04:46.517 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.517 INFO:teuthology.orchestra.run.gibba038.stdout: osd recover clone overlap = true 2021-02-13T17:04:46.517 INFO:teuthology.orchestra.run.gibba038.stdout: osd recovery max chunk = 1048576 2021-02-13T17:04:46.517 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.517 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug shutdown = true 2021-02-13T17:04:46.517 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug op order = true 2021-02-13T17:04:46.517 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug verify stray on activate = true 2021-02-13T17:04:46.517 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.517 INFO:teuthology.orchestra.run.gibba038.stdout: osd open classes on start = true 2021-02-13T17:04:46.517 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug pg log writeout = true 2021-02-13T17:04:46.517 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.518 INFO:teuthology.orchestra.run.gibba038.stdout: osd deep scrub update digest min age = 30 2021-02-13T17:04:46.518 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.518 INFO:teuthology.orchestra.run.gibba038.stdout: osd map max advance = 10 2021-02-13T17:04:46.518 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.518 INFO:teuthology.orchestra.run.gibba038.stdout: journal zero on create = true 2021-02-13T17:04:46.518 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.518 INFO:teuthology.orchestra.run.gibba038.stdout: filestore ondisk finisher threads = 3 2021-02-13T17:04:46.518 INFO:teuthology.orchestra.run.gibba038.stdout: filestore apply finisher threads = 3 2021-02-13T17:04:46.518 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.519 INFO:teuthology.orchestra.run.gibba038.stdout: bdev debug aio = true 2021-02-13T17:04:46.519 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug misdirected ops = true 2021-02-13T17:04:46.519 INFO:teuthology.orchestra.run.gibba038.stdout: debug filestore = 20 2021-02-13T17:04:46.519 INFO:teuthology.orchestra.run.gibba038.stdout: debug journal = 20 2021-02-13T17:04:46.519 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 20 2021-02-13T17:04:46.519 INFO:teuthology.orchestra.run.gibba038.stdout: debug osd = 25 2021-02-13T17:04:46.519 INFO:teuthology.orchestra.run.gibba038.stdout: osd fast shutdown = False 2021-02-13T17:04:46.519 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.519 INFO:teuthology.orchestra.run.gibba038.stdout:[mgr] 2021-02-13T17:04:46.519 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-02-13T17:04:46.519 INFO:teuthology.orchestra.run.gibba038.stdout: debug mgr = 20 2021-02-13T17:04:46.519 INFO:teuthology.orchestra.run.gibba038.stdout: debug mon = 20 2021-02-13T17:04:46.519 INFO:teuthology.orchestra.run.gibba038.stdout: debug auth = 20 2021-02-13T17:04:46.519 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min pgs per osd = 4 2021-02-13T17:04:46.520 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min bytes per osd = 10 2021-02-13T17:04:46.520 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.520 INFO:teuthology.orchestra.run.gibba038.stdout:[mon] 2021-02-13T17:04:46.520 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-02-13T17:04:46.520 INFO:teuthology.orchestra.run.gibba038.stdout: debug mon = 20 2021-02-13T17:04:46.520 INFO:teuthology.orchestra.run.gibba038.stdout: debug paxos = 20 2021-02-13T17:04:46.520 INFO:teuthology.orchestra.run.gibba038.stdout: debug auth = 20 2021-02-13T17:04:46.520 INFO:teuthology.orchestra.run.gibba038.stdout: mon data avail warn = 5 2021-02-13T17:04:46.520 INFO:teuthology.orchestra.run.gibba038.stdout: mon mgr mkfs grace = 240 2021-02-13T17:04:46.520 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min pgs per osd = 4 2021-02-13T17:04:46.520 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd reporter subtree level = osd 2021-02-13T17:04:46.520 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd prime pg temp = true 2021-02-13T17:04:46.520 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min bytes per osd = 10 2021-02-13T17:04:46.520 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd crush smoke test = False 2021-02-13T17:04:46.520 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:04:46.521 INFO:teuthology.orchestra.run.gibba038.stdout:[client] 2021-02-13T17:04:46.521 INFO:teuthology.orchestra.run.gibba038.stdout: rgw cache enabled = true 2021-02-13T17:04:46.521 INFO:teuthology.orchestra.run.gibba038.stdout: rgw enable ops log = true 2021-02-13T17:04:46.521 INFO:teuthology.orchestra.run.gibba038.stdout: rgw enable usage log = true 2021-02-13T17:04:46.521 INFO:teuthology.orchestra.run.gibba038.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-13T17:04:46.521 INFO:teuthology.orchestra.run.gibba038.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-13T17:04:46.521 INFO:teuthology.orchestra.run.gibba038.stdout: debug rgw = 20 2021-02-13T17:04:46.521 INFO:teuthology.orchestra.run.gibba038.stdout: rgw crypt require ssl = False 2021-02-13T17:04:46.521 INFO:teuthology.orchestra.run.gibba038.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-02-13T17:04:46.521 INFO:teuthology.orchestra.run.gibba038.stdout: rgw curl low speed time = 300 2021-02-13T17:04:46.521 INFO:teuthology.orchestra.run.gibba038.stdout: rgw data log num shards = 4 2021-02-13T17:04:46.521 INFO:teuthology.orchestra.run.gibba038.stdout: rgw md log max shards = 4 2021-02-13T17:04:46.521 INFO:teuthology.orchestra.run.gibba038.stdout: rgw sync log trim interval = 0 2021-02-13T17:04:46.521 INFO:teuthology.orchestra.run.gibba038.stdout: rgw sync obj etag verify = True 2021-02-13T17:04:46.522 INFO:teuthology.orchestra.run.gibba038.stdout:[mon.a] 2021-02-13T17:04:46.522 INFO:teuthology.orchestra.run.gibba038.stdout:[osd.0] 2021-02-13T17:04:46.522 INFO:teuthology.orchestra.run.gibba038.stdout: osd_max_omap_entries_per_request = 10 2021-02-13T17:04:46.522 INFO:teuthology.orchestra.run.gibba038.stdout:[osd.1] 2021-02-13T17:04:46.522 INFO:teuthology.orchestra.run.gibba038.stdout: osd_max_omap_entries_per_request = 1000 2021-02-13T17:04:46.522 INFO:teuthology.orchestra.run.gibba038.stdout:[osd.2] 2021-02-13T17:04:46.522 INFO:teuthology.orchestra.run.gibba038.stdout: osd_max_omap_entries_per_request = 10000 2021-02-13T17:04:46.522 INFO:tasks.ceph:Creating admin key on c1.mon.a... 2021-02-13T17:04:46.523 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c1.keyring 2021-02-13T17:04:46.624 INFO:tasks.ceph:Copying monmap to all nodes... 2021-02-13T17:04:46.630 DEBUG:teuthology.orchestra.remote:gibba037:/etc/ceph/c1.keyring is 206B 2021-02-13T17:04:46.684 DEBUG:teuthology.orchestra.remote:gibba037:/home/ubuntu/cephtest/c1.monmap is 177B 2021-02-13T17:04:46.694 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba037.front.sepia.ceph.com 2021-02-13T17:04:46.694 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-02-13T17:04:46.694 DEBUG:teuthology.orchestra.run.gibba037:> sudo dd of=/etc/ceph/c1.keyring 2021-02-13T17:04:46.694 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-02-13T17:04:46.708 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-02-13T17:04:46.708 DEBUG:teuthology.orchestra.run.gibba037:> dd of=/home/ubuntu/cephtest/c1.monmap 2021-02-13T17:04:46.753 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba038.front.sepia.ceph.com 2021-02-13T17:04:46.754 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-02-13T17:04:46.754 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/etc/ceph/c1.keyring 2021-02-13T17:04:46.754 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-02-13T17:04:46.781 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-02-13T17:04:46.781 DEBUG:teuthology.orchestra.run.gibba038:> dd of=/home/ubuntu/cephtest/c1.monmap 2021-02-13T17:04:46.828 INFO:tasks.ceph:Setting up mon nodes... 2021-02-13T17:04:46.828 INFO:tasks.ceph:Setting up mgr nodes... 2021-02-13T17:04:46.829 DEBUG:teuthology.orchestra.run.gibba037:> sudo mkdir -p /var/lib/ceph/mgr/c1-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c1-x/keyring 2021-02-13T17:04:46.853 INFO:teuthology.orchestra.run.gibba037.stdout:creating /var/lib/ceph/mgr/c1-x/keyring 2021-02-13T17:04:46.854 INFO:tasks.ceph:Setting up mds nodes... 2021-02-13T17:04:46.854 INFO:tasks.ceph_client:Setting up client nodes... 2021-02-13T17:04:46.855 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c1.client.0.keyring && sudo chmod 0644 /etc/ceph/c1.client.0.keyring 2021-02-13T17:04:46.915 INFO:teuthology.orchestra.run.gibba037.stdout:creating /etc/ceph/c1.client.0.keyring 2021-02-13T17:04:46.919 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/c1.client.1.keyring && sudo chmod 0644 /etc/ceph/c1.client.1.keyring 2021-02-13T17:04:46.990 INFO:teuthology.orchestra.run.gibba037.stdout:creating /etc/ceph/c1.client.1.keyring 2021-02-13T17:04:46.999 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-02-13T17:04:47.000 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@gibba037.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}} 2021-02-13T17:04:47.000 DEBUG:teuthology.orchestra.run.gibba037:> sudo mkdir -p /var/lib/ceph/osd/c1-0 2021-02-13T17:04:47.051 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-02-13T17:04:47.051 INFO:tasks.ceph:role: c1.osd.0 2021-02-13T17:04:47.051 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@gibba037.front.sepia.ceph.com 2021-02-13T17:04:47.052 DEBUG:teuthology.orchestra.run.gibba037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-02-13T17:04:47.132 INFO:teuthology.orchestra.run.gibba037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5505024 blks 2021-02-13T17:04:47.132 INFO:teuthology.orchestra.run.gibba037.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-13T17:04:47.133 INFO:teuthology.orchestra.run.gibba037.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-02-13T17:04:47.133 INFO:teuthology.orchestra.run.gibba037.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-02-13T17:04:47.133 INFO:teuthology.orchestra.run.gibba037.stdout: = sunit=0 swidth=0 blks 2021-02-13T17:04:47.133 INFO:teuthology.orchestra.run.gibba037.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-02-13T17:04:47.133 INFO:teuthology.orchestra.run.gibba037.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-02-13T17:04:47.133 INFO:teuthology.orchestra.run.gibba037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-13T17:04:47.133 INFO:teuthology.orchestra.run.gibba037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-13T17:04:47.135 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@gibba037.front.sepia.ceph.com -o noatime 2021-02-13T17:04:47.135 DEBUG:teuthology.orchestra.run.gibba037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c1-0 2021-02-13T17:04:47.206 DEBUG:teuthology.orchestra.run.gibba037:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-0 2021-02-13T17:04:47.263 INFO:teuthology.orchestra.run.gibba037.stderr:sudo: /sbin/restorecon: command not found 2021-02-13T17:04:47.264 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-13T17:04:47.264 DEBUG:teuthology.orchestra.run.gibba037:> sudo mkdir -p /var/lib/ceph/osd/c1-1 2021-02-13T17:04:47.323 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-02-13T17:04:47.324 INFO:tasks.ceph:role: c1.osd.1 2021-02-13T17:04:47.324 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@gibba037.front.sepia.ceph.com 2021-02-13T17:04:47.324 DEBUG:teuthology.orchestra.run.gibba037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-02-13T17:04:47.406 INFO:teuthology.orchestra.run.gibba037.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5505024 blks 2021-02-13T17:04:47.406 INFO:teuthology.orchestra.run.gibba037.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-13T17:04:47.406 INFO:teuthology.orchestra.run.gibba037.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-02-13T17:04:47.406 INFO:teuthology.orchestra.run.gibba037.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-02-13T17:04:47.406 INFO:teuthology.orchestra.run.gibba037.stdout: = sunit=0 swidth=0 blks 2021-02-13T17:04:47.407 INFO:teuthology.orchestra.run.gibba037.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-02-13T17:04:47.407 INFO:teuthology.orchestra.run.gibba037.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-02-13T17:04:47.407 INFO:teuthology.orchestra.run.gibba037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-13T17:04:47.407 INFO:teuthology.orchestra.run.gibba037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-13T17:04:47.408 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@gibba037.front.sepia.ceph.com -o noatime 2021-02-13T17:04:47.408 DEBUG:teuthology.orchestra.run.gibba037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c1-1 2021-02-13T17:04:47.480 DEBUG:teuthology.orchestra.run.gibba037:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-1 2021-02-13T17:04:47.531 INFO:teuthology.orchestra.run.gibba037.stderr:sudo: /sbin/restorecon: command not found 2021-02-13T17:04:47.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-13T17:04:47.532 DEBUG:teuthology.orchestra.run.gibba037:> sudo mkdir -p /var/lib/ceph/osd/c1-2 2021-02-13T17:04:47.582 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-02-13T17:04:47.582 INFO:tasks.ceph:role: c1.osd.2 2021-02-13T17:04:47.582 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@gibba037.front.sepia.ceph.com 2021-02-13T17:04:47.582 DEBUG:teuthology.orchestra.run.gibba037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-02-13T17:04:47.665 INFO:teuthology.orchestra.run.gibba037.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5505024 blks 2021-02-13T17:04:47.665 INFO:teuthology.orchestra.run.gibba037.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-13T17:04:47.665 INFO:teuthology.orchestra.run.gibba037.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-02-13T17:04:47.665 INFO:teuthology.orchestra.run.gibba037.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-02-13T17:04:47.665 INFO:teuthology.orchestra.run.gibba037.stdout: = sunit=0 swidth=0 blks 2021-02-13T17:04:47.665 INFO:teuthology.orchestra.run.gibba037.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-02-13T17:04:47.665 INFO:teuthology.orchestra.run.gibba037.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-02-13T17:04:47.665 INFO:teuthology.orchestra.run.gibba037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-13T17:04:47.665 INFO:teuthology.orchestra.run.gibba037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-13T17:04:47.666 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@gibba037.front.sepia.ceph.com -o noatime 2021-02-13T17:04:47.666 DEBUG:teuthology.orchestra.run.gibba037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c1-2 2021-02-13T17:04:47.718 DEBUG:teuthology.orchestra.run.gibba037:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-2 2021-02-13T17:04:47.765 INFO:teuthology.orchestra.run.gibba037.stderr:sudo: /sbin/restorecon: command not found 2021-02-13T17:04:47.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-13T17:04:47.766 DEBUG:teuthology.orchestra.run.gibba037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c1.monmap 2021-02-13T17:04:47.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:04:47.833 7f92cf128c00 -1 auth: error reading file: /var/lib/ceph/osd/c1-0/keyring: can't open /var/lib/ceph/osd/c1-0/keyring: (2) No such file or directory 2021-02-13T17:04:47.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:04:47.833 7f92cf128c00 -1 created new key in keyring /var/lib/ceph/osd/c1-0/keyring 2021-02-13T17:04:47.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:04:47.833 7f92cf128c00 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-02-13T17:04:47.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:04:47.833 7f92cf128c00 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-02-13T17:04:47.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:04:47.833 7f92cf128c00 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-02-13T17:04:47.838 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:04:47.833 7f92cf128c00 -1 bluestore(/var/lib/ceph/osd/c1-0) _read_fsid unparsable uuid 2021-02-13T17:04:50.008 DEBUG:teuthology.orchestra.run.gibba037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-0 2021-02-13T17:04:50.056 DEBUG:teuthology.orchestra.run.gibba037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c1.monmap 2021-02-13T17:04:50.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:04:50.109 7f79cbea2c00 -1 auth: error reading file: /var/lib/ceph/osd/c1-1/keyring: can't open /var/lib/ceph/osd/c1-1/keyring: (2) No such file or directory 2021-02-13T17:04:50.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:04:50.109 7f79cbea2c00 -1 created new key in keyring /var/lib/ceph/osd/c1-1/keyring 2021-02-13T17:04:50.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:04:50.109 7f79cbea2c00 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-02-13T17:04:50.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:04:50.109 7f79cbea2c00 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-02-13T17:04:50.117 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:04:50.109 7f79cbea2c00 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-02-13T17:04:50.118 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:04:50.113 7f79cbea2c00 -1 bluestore(/var/lib/ceph/osd/c1-1) _read_fsid unparsable uuid 2021-02-13T17:04:52.279 DEBUG:teuthology.orchestra.run.gibba037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-1 2021-02-13T17:04:52.332 DEBUG:teuthology.orchestra.run.gibba037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c1.monmap 2021-02-13T17:04:52.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:04:52.385 7fec33fb1c00 -1 auth: error reading file: /var/lib/ceph/osd/c1-2/keyring: can't open /var/lib/ceph/osd/c1-2/keyring: (2) No such file or directory 2021-02-13T17:04:52.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:04:52.385 7fec33fb1c00 -1 created new key in keyring /var/lib/ceph/osd/c1-2/keyring 2021-02-13T17:04:52.393 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:04:52.385 7fec33fb1c00 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-02-13T17:04:52.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:04:52.385 7fec33fb1c00 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-02-13T17:04:52.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:04:52.385 7fec33fb1c00 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-02-13T17:04:52.394 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:04:52.389 7fec33fb1c00 -1 bluestore(/var/lib/ceph/osd/c1-2) _read_fsid unparsable uuid 2021-02-13T17:04:54.567 DEBUG:teuthology.orchestra.run.gibba037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-2 2021-02-13T17:04:54.620 INFO:tasks.ceph:Reading keys from all nodes... 2021-02-13T17:04:54.620 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-02-13T17:04:54.665 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.jOuZR8HNrE 2021-02-13T17:04:54.665 DEBUG:teuthology.orchestra.run.gibba037:> sudo cp /var/lib/ceph/mgr/c1-x/keyring /tmp/tmp.jOuZR8HNrE 2021-02-13T17:04:54.715 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.jOuZR8HNrE 2021-02-13T17:04:54.816 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.jOuZR8HNrE is 56B 2021-02-13T17:04:54.831 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.jOuZR8HNrE 2021-02-13T17:04:54.839 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-02-13T17:04:54.891 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.NdjF8YRYMU 2021-02-13T17:04:54.892 DEBUG:teuthology.orchestra.run.gibba037:> sudo cp /var/lib/ceph/osd/c1-0/keyring /tmp/tmp.NdjF8YRYMU 2021-02-13T17:04:54.941 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.NdjF8YRYMU 2021-02-13T17:04:55.039 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.NdjF8YRYMU is 56B 2021-02-13T17:04:55.093 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.NdjF8YRYMU 2021-02-13T17:04:55.100 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-02-13T17:04:55.145 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.qdBSnJ5ZEn 2021-02-13T17:04:55.146 DEBUG:teuthology.orchestra.run.gibba037:> sudo cp /var/lib/ceph/osd/c1-1/keyring /tmp/tmp.qdBSnJ5ZEn 2021-02-13T17:04:55.211 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.qdBSnJ5ZEn 2021-02-13T17:04:55.311 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.qdBSnJ5ZEn is 56B 2021-02-13T17:04:55.322 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.qdBSnJ5ZEn 2021-02-13T17:04:55.328 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-02-13T17:04:55.377 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.OajtjtpwZc 2021-02-13T17:04:55.378 DEBUG:teuthology.orchestra.run.gibba037:> sudo cp /var/lib/ceph/osd/c1-2/keyring /tmp/tmp.OajtjtpwZc 2021-02-13T17:04:55.442 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.OajtjtpwZc 2021-02-13T17:04:55.556 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.OajtjtpwZc is 56B 2021-02-13T17:04:55.573 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.OajtjtpwZc 2021-02-13T17:04:55.637 DEBUG:teuthology.orchestra.remote:gibba037:/etc/ceph/c1.client.0.keyring is 59B 2021-02-13T17:04:55.702 DEBUG:teuthology.orchestra.remote:gibba037:/etc/ceph/c1.client.1.keyring is 59B 2021-02-13T17:04:55.752 INFO:tasks.ceph:Adding keys to all mons... 2021-02-13T17:04:55.753 DEBUG:teuthology.orchestra.run.gibba037:> sudo tee -a /etc/ceph/c1.keyring 2021-02-13T17:04:55.798 INFO:teuthology.orchestra.run.gibba037.stdout:[mgr.x] 2021-02-13T17:04:55.798 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQCuBihgzge7MhAAly7pjHNus+bna+L0rOYtbw== 2021-02-13T17:04:55.798 INFO:teuthology.orchestra.run.gibba037.stdout:[osd.0] 2021-02-13T17:04:55.798 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQCvBihgZWrQMRAARefsnL/JoKm1iYCgYpJtwA== 2021-02-13T17:04:55.798 INFO:teuthology.orchestra.run.gibba037.stdout:[osd.1] 2021-02-13T17:04:55.798 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQCyBihgqWjWBhAA3frw5MF5JZ8mrA2Rwm3qqA== 2021-02-13T17:04:55.799 INFO:teuthology.orchestra.run.gibba037.stdout:[osd.2] 2021-02-13T17:04:55.799 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQC0BihgXPNQFxAAUHfCel8Kml/uL/C8b7QT/Q== 2021-02-13T17:04:55.799 INFO:teuthology.orchestra.run.gibba037.stdout:[client.0] 2021-02-13T17:04:55.799 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQCuBihgoJltNhAA2/Q6hzLUDPj7pW6LBdkplw== 2021-02-13T17:04:55.799 INFO:teuthology.orchestra.run.gibba037.stdout:[client.1] 2021-02-13T17:04:55.799 INFO:teuthology.orchestra.run.gibba037.stdout: key = AQCuBihgR0DkOhAAONNd+nX+gL2pxADvaITbeg== 2021-02-13T17:04:55.800 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-02-13T17:04:55.865 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-13T17:04:55.928 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-13T17:04:55.999 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-13T17:04:56.109 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-13T17:04:56.134 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-13T17:04:56.202 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-02-13T17:04:56.202 DEBUG:teuthology.orchestra.run.gibba037:> sudo mkdir -p /var/lib/ceph/mon/c1-a 2021-02-13T17:04:56.254 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c1 --mkfs -i a --monmap /home/ubuntu/cephtest/c1.monmap --keyring /etc/ceph/c1.keyring 2021-02-13T17:04:56.342 DEBUG:teuthology.orchestra.run.gibba037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c1-a 2021-02-13T17:04:56.395 DEBUG:teuthology.orchestra.run.gibba037:> rm -- /home/ubuntu/cephtest/c1.monmap 2021-02-13T17:04:56.445 INFO:tasks.ceph:Starting mon daemons in cluster c1... 2021-02-13T17:04:56.445 INFO:tasks.ceph.c1.mon.a:Restarting daemon 2021-02-13T17:04:56.445 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c1 -i a 2021-02-13T17:04:56.488 INFO:tasks.ceph.c1.mon.a:Started 2021-02-13T17:04:56.488 INFO:tasks.ceph:Starting mgr daemons in cluster c1... 2021-02-13T17:04:56.488 INFO:tasks.ceph.c1.mgr.x:Restarting daemon 2021-02-13T17:04:56.488 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c1 -i x 2021-02-13T17:04:56.490 INFO:tasks.ceph.c1.mgr.x:Started 2021-02-13T17:04:56.491 INFO:tasks.ceph:Setting crush tunables to default 2021-02-13T17:04:56.491 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph --cluster c1 osd crush tunables default 2021-02-13T17:04:56.631 INFO:teuthology.orchestra.run.gibba037.stderr:adjusted tunables profile to default 2021-02-13T17:04:56.640 INFO:tasks.ceph:Starting osd daemons in cluster c1... 2021-02-13T17:04:56.640 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-02-13T17:04:56.643 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.4XjMJKMRIU 2021-02-13T17:04:56.643 DEBUG:teuthology.orchestra.run.gibba037:> sudo cp /var/lib/ceph/osd/c1-0/fsid /tmp/tmp.4XjMJKMRIU 2021-02-13T17:04:56.690 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.4XjMJKMRIU 2021-02-13T17:04:56.787 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.4XjMJKMRIU is 37B 2021-02-13T17:04:56.796 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.4XjMJKMRIU 2021-02-13T17:04:56.802 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-02-13T17:04:56.853 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.eu6Ltf3LtK 2021-02-13T17:04:56.853 DEBUG:teuthology.orchestra.run.gibba037:> sudo cp /var/lib/ceph/osd/c1-1/fsid /tmp/tmp.eu6Ltf3LtK 2021-02-13T17:04:56.904 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.eu6Ltf3LtK 2021-02-13T17:04:57.008 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.eu6Ltf3LtK is 37B 2021-02-13T17:04:57.016 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.eu6Ltf3LtK 2021-02-13T17:04:57.019 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-02-13T17:04:57.064 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.Q5rSWAzm1X 2021-02-13T17:04:57.064 DEBUG:teuthology.orchestra.run.gibba037:> sudo cp /var/lib/ceph/osd/c1-2/fsid /tmp/tmp.Q5rSWAzm1X 2021-02-13T17:04:57.111 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.Q5rSWAzm1X 2021-02-13T17:04:57.207 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.Q5rSWAzm1X is 37B 2021-02-13T17:04:57.259 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.Q5rSWAzm1X 2021-02-13T17:04:57.262 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph --cluster c1 osd new 2dfed3f8-f109-4075-96c1-9af5f342c4dd 0 2021-02-13T17:04:57.428 INFO:teuthology.orchestra.run.gibba037.stdout:0 2021-02-13T17:04:57.436 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph --cluster c1 osd new 661cb094-69c9-46f5-83e9-4045725f472d 1 2021-02-13T17:04:57.560 INFO:teuthology.orchestra.run.gibba037.stdout:1 2021-02-13T17:04:57.568 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph --cluster c1 osd new 4052384f-9f5d-4059-88e4-328e529c5898 2 2021-02-13T17:04:57.693 INFO:teuthology.orchestra.run.gibba037.stdout:2 2021-02-13T17:04:57.701 INFO:tasks.ceph.c1.osd.0:Restarting daemon 2021-02-13T17:04:57.701 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 0 2021-02-13T17:04:57.703 INFO:tasks.ceph.c1.osd.0:Started 2021-02-13T17:04:57.703 INFO:tasks.ceph.c1.osd.1:Restarting daemon 2021-02-13T17:04:57.703 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 1 2021-02-13T17:04:57.704 INFO:tasks.ceph.c1.osd.1:Started 2021-02-13T17:04:57.705 INFO:tasks.ceph.c1.osd.2:Restarting daemon 2021-02-13T17:04:57.705 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 2 2021-02-13T17:04:57.708 INFO:tasks.ceph.c1.osd.2:Started 2021-02-13T17:04:57.708 INFO:tasks.ceph:Waiting for OSDs to come up 2021-02-13T17:04:58.011 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2021-02-13T17:04:58.050 INFO:tasks.ceph.c1.osd.0.gibba037.stderr:2021-02-13 17:04:58.045 7fc289d42c00 -1 Falling back to public interface 2021-02-13T17:04:58.133 INFO:teuthology.misc.health.gibba037.stdout: 2021-02-13T17:04:58.133 INFO:teuthology.misc.health.gibba037.stdout:{"epoch":5,"fsid":"611a710d-9f14-45ea-aab7-0ffef279fb6a","created":"2021-02-13 17:04:56.556157","modified":"2021-02-13 17:04:57.687808","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"2dfed3f8-f109-4075-96c1-9af5f342c4dd","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":1,"uuid":"661cb094-69c9-46f5-83e9-4045725f472d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":2,"uuid":"4052384f-9f5d-4059-88e4-328e529c5898","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T17:04:58.140 DEBUG:teuthology.misc:0 of 3 OSDs are up 2021-02-13T17:04:58.270 INFO:tasks.ceph.c1.osd.1.gibba037.stderr:2021-02-13 17:04:58.265 7fac32f23c00 -1 Falling back to public interface 2021-02-13T17:04:58.286 INFO:tasks.ceph.c1.osd.2.gibba037.stderr:2021-02-13 17:04:58.281 7fd9d2284c00 -1 Falling back to public interface 2021-02-13T17:04:58.675 INFO:tasks.ceph.c1.osd.0.gibba037.stderr:2021-02-13 17:04:58.669 7fc289d42c00 -1 osd.0 0 log_to_monitors {default=true} 2021-02-13T17:04:58.863 INFO:tasks.ceph.c1.osd.1.gibba037.stderr:2021-02-13 17:04:58.857 7fac32f23c00 -1 osd.1 0 log_to_monitors {default=true} 2021-02-13T17:04:58.888 INFO:tasks.ceph.c1.osd.2.gibba037.stderr:2021-02-13 17:04:58.881 7fd9d2284c00 -1 osd.2 0 log_to_monitors {default=true} 2021-02-13T17:05:00.597 INFO:tasks.ceph.c1.osd.1.gibba037.stderr:2021-02-13 17:05:00.589 7fac19fc3700 -1 osd.1 0 waiting for initial osdmap 2021-02-13T17:05:00.598 INFO:tasks.ceph.c1.osd.0.gibba037.stderr:2021-02-13 17:05:00.593 7fc270de2700 -1 osd.0 0 waiting for initial osdmap 2021-02-13T17:05:00.599 INFO:tasks.ceph.c1.osd.2.gibba037.stderr:2021-02-13 17:05:00.593 7fd9b9324700 -1 osd.2 0 waiting for initial osdmap 2021-02-13T17:05:00.601 INFO:tasks.ceph.c1.osd.1.gibba037.stderr:2021-02-13 17:05:00.593 7fac267dc700 -1 osd.1 7 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-13T17:05:00.601 INFO:tasks.ceph.c1.osd.2.gibba037.stderr:2021-02-13 17:05:00.593 7fd9c5b3d700 -1 osd.2 7 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-13T17:05:00.602 INFO:tasks.ceph.c1.osd.0.gibba037.stderr:2021-02-13 17:05:00.593 7fc27d5fb700 -1 osd.0 7 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-13T17:05:04.444 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2021-02-13T17:05:04.602 INFO:teuthology.misc.health.gibba037.stdout: 2021-02-13T17:05:04.602 INFO:teuthology.misc.health.gibba037.stdout:{"epoch":8,"fsid":"611a710d-9f14-45ea-aab7-0ffef279fb6a","created":"2021-02-13 17:04:56.556157","modified":"2021-02-13 17:05:01.585621","last_up_change":"2021-02-13 17:05:01.585621","last_in_change":"2021-02-13 17:05:01.585621","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"2dfed3f8-f109-4075-96c1-9af5f342c4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14263},{"type":"v1","addr":"172.21.2.137:6801","nonce":14263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14263},{"type":"v1","addr":"172.21.2.137:6803","nonce":14263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14263},{"type":"v1","addr":"172.21.2.137:6807","nonce":14263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14263},{"type":"v1","addr":"172.21.2.137:6805","nonce":14263}]},"public_addr":"172.21.2.137:6801/14263","cluster_addr":"172.21.2.137:6803/14263","heartbeat_back_addr":"172.21.2.137:6807/14263","heartbeat_front_addr":"172.21.2.137:6805/14263","state":["exists","up"]},{"osd":1,"uuid":"661cb094-69c9-46f5-83e9-4045725f472d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14264},{"type":"v1","addr":"172.21.2.137:6809","nonce":14264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14264},{"type":"v1","addr":"172.21.2.137:6811","nonce":14264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14264},{"type":"v1","addr":"172.21.2.137:6815","nonce":14264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14264},{"type":"v1","addr":"172.21.2.137:6813","nonce":14264}]},"public_addr":"172.21.2.137:6809/14264","cluster_addr":"172.21.2.137:6811/14264","heartbeat_back_addr":"172.21.2.137:6815/14264","heartbeat_front_addr":"172.21.2.137:6813/14264","state":["exists","up"]},{"osd":2,"uuid":"4052384f-9f5d-4059-88e4-328e529c5898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14265},{"type":"v1","addr":"172.21.2.137:6817","nonce":14265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14265},{"type":"v1","addr":"172.21.2.137:6819","nonce":14265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14265},{"type":"v1","addr":"172.21.2.137:6823","nonce":14265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14265},{"type":"v1","addr":"172.21.2.137:6821","nonce":14265}]},"public_addr":"172.21.2.137:6817/14265","cluster_addr":"172.21.2.137:6819/14265","heartbeat_back_addr":"172.21.2.137:6823/14265","heartbeat_front_addr":"172.21.2.137:6821/14265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T17:05:04.616 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-02-13T17:05:04.616 INFO:tasks.ceph:Creating RBD pool 2021-02-13T17:05:04.616 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph --cluster c1 osd pool create rbd 8 2021-02-13T17:05:05.692 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'rbd' created 2021-02-13T17:05:05.703 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph --cluster c1 osd pool application enable rbd rbd --yes-i-really-mean-it 2021-02-13T17:05:06.694 INFO:teuthology.orchestra.run.gibba037.stderr:enabled application 'rbd' on pool 'rbd' 2021-02-13T17:05:06.706 INFO:tasks.ceph:Starting mds daemons in cluster c1... 2021-02-13T17:05:06.707 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 osd dump --format=json 2021-02-13T17:05:06.857 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:06.857 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":10,"fsid":"611a710d-9f14-45ea-aab7-0ffef279fb6a","created":"2021-02-13 17:04:56.556157","modified":"2021-02-13 17:05:06.655742","last_up_change":"2021-02-13 17:05:01.585621","last_in_change":"2021-02-13 17:05:01.585621","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-13 17:05:04.769870","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"2dfed3f8-f109-4075-96c1-9af5f342c4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14263},{"type":"v1","addr":"172.21.2.137:6801","nonce":14263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14263},{"type":"v1","addr":"172.21.2.137:6803","nonce":14263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14263},{"type":"v1","addr":"172.21.2.137:6807","nonce":14263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14263},{"type":"v1","addr":"172.21.2.137:6805","nonce":14263}]},"public_addr":"172.21.2.137:6801/14263","cluster_addr":"172.21.2.137:6803/14263","heartbeat_back_addr":"172.21.2.137:6807/14263","heartbeat_front_addr":"172.21.2.137:6805/14263","state":["exists","up"]},{"osd":1,"uuid":"661cb094-69c9-46f5-83e9-4045725f472d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14264},{"type":"v1","addr":"172.21.2.137:6809","nonce":14264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14264},{"type":"v1","addr":"172.21.2.137:6811","nonce":14264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14264},{"type":"v1","addr":"172.21.2.137:6815","nonce":14264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14264},{"type":"v1","addr":"172.21.2.137:6813","nonce":14264}]},"public_addr":"172.21.2.137:6809/14264","cluster_addr":"172.21.2.137:6811/14264","heartbeat_back_addr":"172.21.2.137:6815/14264","heartbeat_front_addr":"172.21.2.137:6813/14264","state":["exists","up"]},{"osd":2,"uuid":"4052384f-9f5d-4059-88e4-328e529c5898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14265},{"type":"v1","addr":"172.21.2.137:6817","nonce":14265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14265},{"type":"v1","addr":"172.21.2.137:6819","nonce":14265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14265},{"type":"v1","addr":"172.21.2.137:6823","nonce":14265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14265},{"type":"v1","addr":"172.21.2.137:6821","nonce":14265}]},"public_addr":"172.21.2.137:6817/14265","cluster_addr":"172.21.2.137:6819/14265","heartbeat_back_addr":"172.21.2.137:6823/14265","heartbeat_front_addr":"172.21.2.137:6821/14265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T17:05:06.865 INFO:tasks.ceph.ceph_manager.c1:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-02-13 17:05:04.769870', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-13T17:05:06.866 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 osd pool get rbd pg_num 2021-02-13T17:05:07.024 INFO:teuthology.orchestra.run.gibba037.stdout:pg_num: 8 2021-02-13T17:05:07.032 INFO:tasks.ceph:Waiting until c1 daemons up and pgs clean... 2021-02-13T17:05:07.032 INFO:tasks.ceph.ceph_manager.c1:waiting for mgr available 2021-02-13T17:05:07.033 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 mgr dump --format=json 2021-02-13T17:05:07.213 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:07.221 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":3,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6824","nonce":14041},{"type":"v1","addr":"172.21.2.137:6825","nonce":14041}]},"active_addr":"172.21.2.137:6825/14041","active_change":"2021-02-13 17:04:58.576756","available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout_min":{"name":"inventory_cache_timeout_min","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"]}} 2021-02-13T17:05:07.222 INFO:tasks.ceph.ceph_manager.c1:mgr available! 2021-02-13T17:05:07.526 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2021-02-13T17:05:07.683 INFO:teuthology.misc.health.gibba037.stdout: 2021-02-13T17:05:07.683 INFO:teuthology.misc.health.gibba037.stdout:{"epoch":11,"fsid":"611a710d-9f14-45ea-aab7-0ffef279fb6a","created":"2021-02-13 17:04:56.556157","modified":"2021-02-13 17:05:07.657104","last_up_change":"2021-02-13 17:05:01.585621","last_in_change":"2021-02-13 17:05:01.585621","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-13 17:05:04.769870","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"2dfed3f8-f109-4075-96c1-9af5f342c4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14263},{"type":"v1","addr":"172.21.2.137:6801","nonce":14263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14263},{"type":"v1","addr":"172.21.2.137:6803","nonce":14263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14263},{"type":"v1","addr":"172.21.2.137:6807","nonce":14263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14263},{"type":"v1","addr":"172.21.2.137:6805","nonce":14263}]},"public_addr":"172.21.2.137:6801/14263","cluster_addr":"172.21.2.137:6803/14263","heartbeat_back_addr":"172.21.2.137:6807/14263","heartbeat_front_addr":"172.21.2.137:6805/14263","state":["exists","up"]},{"osd":1,"uuid":"661cb094-69c9-46f5-83e9-4045725f472d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14264},{"type":"v1","addr":"172.21.2.137:6809","nonce":14264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14264},{"type":"v1","addr":"172.21.2.137:6811","nonce":14264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14264},{"type":"v1","addr":"172.21.2.137:6815","nonce":14264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14264},{"type":"v1","addr":"172.21.2.137:6813","nonce":14264}]},"public_addr":"172.21.2.137:6809/14264","cluster_addr":"172.21.2.137:6811/14264","heartbeat_back_addr":"172.21.2.137:6815/14264","heartbeat_front_addr":"172.21.2.137:6813/14264","state":["exists","up"]},{"osd":2,"uuid":"4052384f-9f5d-4059-88e4-328e529c5898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14265},{"type":"v1","addr":"172.21.2.137:6817","nonce":14265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14265},{"type":"v1","addr":"172.21.2.137:6819","nonce":14265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14265},{"type":"v1","addr":"172.21.2.137:6823","nonce":14265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14265},{"type":"v1","addr":"172.21.2.137:6821","nonce":14265}]},"public_addr":"172.21.2.137:6817/14265","cluster_addr":"172.21.2.137:6819/14265","heartbeat_back_addr":"172.21.2.137:6823/14265","heartbeat_front_addr":"172.21.2.137:6821/14265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T17:05:07.691 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-02-13T17:05:07.691 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 osd dump --format=json 2021-02-13T17:05:07.841 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:07.842 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":11,"fsid":"611a710d-9f14-45ea-aab7-0ffef279fb6a","created":"2021-02-13 17:04:56.556157","modified":"2021-02-13 17:05:07.657104","last_up_change":"2021-02-13 17:05:01.585621","last_in_change":"2021-02-13 17:05:01.585621","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-13 17:05:04.769870","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"2dfed3f8-f109-4075-96c1-9af5f342c4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14263},{"type":"v1","addr":"172.21.2.137:6801","nonce":14263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14263},{"type":"v1","addr":"172.21.2.137:6803","nonce":14263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14263},{"type":"v1","addr":"172.21.2.137:6807","nonce":14263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14263},{"type":"v1","addr":"172.21.2.137:6805","nonce":14263}]},"public_addr":"172.21.2.137:6801/14263","cluster_addr":"172.21.2.137:6803/14263","heartbeat_back_addr":"172.21.2.137:6807/14263","heartbeat_front_addr":"172.21.2.137:6805/14263","state":["exists","up"]},{"osd":1,"uuid":"661cb094-69c9-46f5-83e9-4045725f472d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14264},{"type":"v1","addr":"172.21.2.137:6809","nonce":14264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14264},{"type":"v1","addr":"172.21.2.137:6811","nonce":14264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14264},{"type":"v1","addr":"172.21.2.137:6815","nonce":14264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14264},{"type":"v1","addr":"172.21.2.137:6813","nonce":14264}]},"public_addr":"172.21.2.137:6809/14264","cluster_addr":"172.21.2.137:6811/14264","heartbeat_back_addr":"172.21.2.137:6815/14264","heartbeat_front_addr":"172.21.2.137:6813/14264","state":["exists","up"]},{"osd":2,"uuid":"4052384f-9f5d-4059-88e4-328e529c5898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14265},{"type":"v1","addr":"172.21.2.137:6817","nonce":14265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14265},{"type":"v1","addr":"172.21.2.137:6819","nonce":14265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14265},{"type":"v1","addr":"172.21.2.137:6823","nonce":14265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14265},{"type":"v1","addr":"172.21.2.137:6821","nonce":14265}]},"public_addr":"172.21.2.137:6817/14265","cluster_addr":"172.21.2.137:6819/14265","heartbeat_back_addr":"172.21.2.137:6823/14265","heartbeat_front_addr":"172.21.2.137:6821/14265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T17:05:07.854 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 tell osd.0 flush_pg_stats 2021-02-13T17:05:07.910 INFO:teuthology.orchestra.run.gibba037.stdout:34359738372 2021-02-13T17:05:07.918 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 tell osd.1 flush_pg_stats 2021-02-13T17:05:07.975 INFO:teuthology.orchestra.run.gibba037.stdout:34359738371 2021-02-13T17:05:07.982 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 tell osd.2 flush_pg_stats 2021-02-13T17:05:08.039 INFO:teuthology.orchestra.run.gibba037.stdout:34359738372 2021-02-13T17:05:08.047 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 osd last-stat-seq osd.0 2021-02-13T17:05:08.220 INFO:teuthology.orchestra.run.gibba037.stdout:34359738370 2021-02-13T17:05:08.228 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738372 got 34359738370 for osd.0 2021-02-13T17:05:09.230 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 osd last-stat-seq osd.0 2021-02-13T17:05:09.397 INFO:teuthology.orchestra.run.gibba037.stdout:34359738372 2021-02-13T17:05:09.405 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738372 got 34359738372 for osd.0 2021-02-13T17:05:09.406 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 osd last-stat-seq osd.1 2021-02-13T17:05:09.565 INFO:teuthology.orchestra.run.gibba037.stdout:34359738371 2021-02-13T17:05:09.574 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738371 got 34359738371 for osd.1 2021-02-13T17:05:09.574 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 osd last-stat-seq osd.2 2021-02-13T17:05:09.735 INFO:teuthology.orchestra.run.gibba037.stdout:34359738372 2021-02-13T17:05:09.744 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738372 got 34359738372 for osd.2 2021-02-13T17:05:09.744 INFO:tasks.ceph.ceph_manager.c1:waiting for clean 2021-02-13T17:05:09.744 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 pg dump --format=json 2021-02-13T17:05:09.903 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:09.903 INFO:teuthology.orchestra.run.gibba037.stderr:dumped all 2021-02-13T17:05:09.911 INFO:teuthology.orchestra.run.gibba037.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2021-02-13 17:05:08.581398","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":3,"kb":314572800,"kb_used":3146024,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426776,"statfs":{"total":322122547200,"available":318901018624,"internally_reserved":3221225472,"allocated":278528,"data_stored":65370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:06.661422","last_change":"2021-02-13 17:05:06.660848","last_active":"2021-02-13 17:05:06.661422","last_peered":"2021-02-13 17:05:06.661422","last_clean":"2021-02-13 17:05:06.661422","last_became_active":"2021-02-13 17:05:06.660601","last_became_peered":"2021-02-13 17:05:06.660601","last_unstale":"2021-02-13 17:05:06.661422","last_undegraded":"2021-02-13 17:05:06.661422","last_fullsized":"2021-02-13 17:05:06.661422","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:05.650269","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:05.650269","last_clean_scrub_stamp":"2021-02-13 17:05:05.650269","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:06.661575","last_change":"2021-02-13 17:05:06.661170","last_active":"2021-02-13 17:05:06.661575","last_peered":"2021-02-13 17:05:06.661575","last_clean":"2021-02-13 17:05:06.661575","last_became_active":"2021-02-13 17:05:06.660929","last_became_peered":"2021-02-13 17:05:06.660929","last_unstale":"2021-02-13 17:05:06.661575","last_undegraded":"2021-02-13 17:05:06.661575","last_fullsized":"2021-02-13 17:05:06.661575","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:05.650269","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:05.650269","last_clean_scrub_stamp":"2021-02-13 17:05:05.650269","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:06.660650","last_change":"2021-02-13 17:05:06.660650","last_active":"2021-02-13 17:05:06.660650","last_peered":"2021-02-13 17:05:06.660650","last_clean":"2021-02-13 17:05:06.660650","last_became_active":"2021-02-13 17:05:06.660391","last_became_peered":"2021-02-13 17:05:06.660391","last_unstale":"2021-02-13 17:05:06.660650","last_undegraded":"2021-02-13 17:05:06.660650","last_fullsized":"2021-02-13 17:05:06.660650","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:05.650269","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:05.650269","last_clean_scrub_stamp":"2021-02-13 17:05:05.650269","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:06.660751","last_change":"2021-02-13 17:05:06.660406","last_active":"2021-02-13 17:05:06.660751","last_peered":"2021-02-13 17:05:06.660751","last_clean":"2021-02-13 17:05:06.660751","last_became_active":"2021-02-13 17:05:06.660169","last_became_peered":"2021-02-13 17:05:06.660169","last_unstale":"2021-02-13 17:05:06.660751","last_undegraded":"2021-02-13 17:05:06.660751","last_fullsized":"2021-02-13 17:05:06.660751","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:05.650269","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:05.650269","last_clean_scrub_stamp":"2021-02-13 17:05:05.650269","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:06.659977","last_change":"2021-02-13 17:05:06.659977","last_active":"2021-02-13 17:05:06.659977","last_peered":"2021-02-13 17:05:06.659977","last_clean":"2021-02-13 17:05:06.659977","last_became_active":"2021-02-13 17:05:06.659787","last_became_peered":"2021-02-13 17:05:06.659787","last_unstale":"2021-02-13 17:05:06.659977","last_undegraded":"2021-02-13 17:05:06.659977","last_fullsized":"2021-02-13 17:05:06.659977","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:05.650269","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:05.650269","last_clean_scrub_stamp":"2021-02-13 17:05:05.650269","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:06.661415","last_change":"2021-02-13 17:05:06.660732","last_active":"2021-02-13 17:05:06.661415","last_peered":"2021-02-13 17:05:06.661415","last_clean":"2021-02-13 17:05:06.661415","last_became_active":"2021-02-13 17:05:06.660461","last_became_peered":"2021-02-13 17:05:06.660461","last_unstale":"2021-02-13 17:05:06.661415","last_undegraded":"2021-02-13 17:05:06.661415","last_fullsized":"2021-02-13 17:05:06.661415","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:05.650269","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:05.650269","last_clean_scrub_stamp":"2021-02-13 17:05:05.650269","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:06.661425","last_change":"2021-02-13 17:05:06.661040","last_active":"2021-02-13 17:05:06.661425","last_peered":"2021-02-13 17:05:06.661425","last_clean":"2021-02-13 17:05:06.661425","last_became_active":"2021-02-13 17:05:06.660766","last_became_peered":"2021-02-13 17:05:06.660766","last_unstale":"2021-02-13 17:05:06.661425","last_undegraded":"2021-02-13 17:05:06.661425","last_fullsized":"2021-02-13 17:05:06.661425","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:05.650269","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:05.650269","last_clean_scrub_stamp":"2021-02-13 17:05:05.650269","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:06.660428","last_change":"2021-02-13 17:05:06.660428","last_active":"2021-02-13 17:05:06.660428","last_peered":"2021-02-13 17:05:06.660428","last_clean":"2021-02-13 17:05:06.660428","last_became_active":"2021-02-13 17:05:06.660210","last_became_peered":"2021-02-13 17:05:06.660210","last_unstale":"2021-02-13 17:05:06.660428","last_undegraded":"2021-02-13 17:05:06.660428","last_fullsized":"2021-02-13 17:05:06.660428","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:05.650269","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:05.650269","last_clean_scrub_stamp":"2021-02-13 17:05:05.650269","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048672,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808928,"statfs":{"total":107374182400,"available":106300342272,"internally_reserved":1073741824,"allocated":90112,"data_stored":20765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9670000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048672,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808928,"statfs":{"total":107374182400,"available":106300342272,"internally_reserved":1073741824,"allocated":90112,"data_stored":20765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2410000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.032}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048680,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808920,"statfs":{"total":107374182400,"available":106300334080,"internally_reserved":1073741824,"allocated":98304,"data_stored":23840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0270000000000001}]}]}]}} 2021-02-13T17:05:09.912 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 pg dump --format=json 2021-02-13T17:05:10.069 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:10.069 INFO:teuthology.orchestra.run.gibba037.stderr:dumped all 2021-02-13T17:05:10.076 INFO:teuthology.orchestra.run.gibba037.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2021-02-13 17:05:08.581398","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":3,"kb":314572800,"kb_used":3146024,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426776,"statfs":{"total":322122547200,"available":318901018624,"internally_reserved":3221225472,"allocated":278528,"data_stored":65370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:06.661422","last_change":"2021-02-13 17:05:06.660848","last_active":"2021-02-13 17:05:06.661422","last_peered":"2021-02-13 17:05:06.661422","last_clean":"2021-02-13 17:05:06.661422","last_became_active":"2021-02-13 17:05:06.660601","last_became_peered":"2021-02-13 17:05:06.660601","last_unstale":"2021-02-13 17:05:06.661422","last_undegraded":"2021-02-13 17:05:06.661422","last_fullsized":"2021-02-13 17:05:06.661422","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:05.650269","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:05.650269","last_clean_scrub_stamp":"2021-02-13 17:05:05.650269","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:06.661575","last_change":"2021-02-13 17:05:06.661170","last_active":"2021-02-13 17:05:06.661575","last_peered":"2021-02-13 17:05:06.661575","last_clean":"2021-02-13 17:05:06.661575","last_became_active":"2021-02-13 17:05:06.660929","last_became_peered":"2021-02-13 17:05:06.660929","last_unstale":"2021-02-13 17:05:06.661575","last_undegraded":"2021-02-13 17:05:06.661575","last_fullsized":"2021-02-13 17:05:06.661575","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:05.650269","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:05.650269","last_clean_scrub_stamp":"2021-02-13 17:05:05.650269","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:06.660650","last_change":"2021-02-13 17:05:06.660650","last_active":"2021-02-13 17:05:06.660650","last_peered":"2021-02-13 17:05:06.660650","last_clean":"2021-02-13 17:05:06.660650","last_became_active":"2021-02-13 17:05:06.660391","last_became_peered":"2021-02-13 17:05:06.660391","last_unstale":"2021-02-13 17:05:06.660650","last_undegraded":"2021-02-13 17:05:06.660650","last_fullsized":"2021-02-13 17:05:06.660650","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:05.650269","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:05.650269","last_clean_scrub_stamp":"2021-02-13 17:05:05.650269","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:06.660751","last_change":"2021-02-13 17:05:06.660406","last_active":"2021-02-13 17:05:06.660751","last_peered":"2021-02-13 17:05:06.660751","last_clean":"2021-02-13 17:05:06.660751","last_became_active":"2021-02-13 17:05:06.660169","last_became_peered":"2021-02-13 17:05:06.660169","last_unstale":"2021-02-13 17:05:06.660751","last_undegraded":"2021-02-13 17:05:06.660751","last_fullsized":"2021-02-13 17:05:06.660751","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:05.650269","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:05.650269","last_clean_scrub_stamp":"2021-02-13 17:05:05.650269","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:06.659977","last_change":"2021-02-13 17:05:06.659977","last_active":"2021-02-13 17:05:06.659977","last_peered":"2021-02-13 17:05:06.659977","last_clean":"2021-02-13 17:05:06.659977","last_became_active":"2021-02-13 17:05:06.659787","last_became_peered":"2021-02-13 17:05:06.659787","last_unstale":"2021-02-13 17:05:06.659977","last_undegraded":"2021-02-13 17:05:06.659977","last_fullsized":"2021-02-13 17:05:06.659977","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:05.650269","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:05.650269","last_clean_scrub_stamp":"2021-02-13 17:05:05.650269","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:06.661415","last_change":"2021-02-13 17:05:06.660732","last_active":"2021-02-13 17:05:06.661415","last_peered":"2021-02-13 17:05:06.661415","last_clean":"2021-02-13 17:05:06.661415","last_became_active":"2021-02-13 17:05:06.660461","last_became_peered":"2021-02-13 17:05:06.660461","last_unstale":"2021-02-13 17:05:06.661415","last_undegraded":"2021-02-13 17:05:06.661415","last_fullsized":"2021-02-13 17:05:06.661415","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:05.650269","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:05.650269","last_clean_scrub_stamp":"2021-02-13 17:05:05.650269","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:06.661425","last_change":"2021-02-13 17:05:06.661040","last_active":"2021-02-13 17:05:06.661425","last_peered":"2021-02-13 17:05:06.661425","last_clean":"2021-02-13 17:05:06.661425","last_became_active":"2021-02-13 17:05:06.660766","last_became_peered":"2021-02-13 17:05:06.660766","last_unstale":"2021-02-13 17:05:06.661425","last_undegraded":"2021-02-13 17:05:06.661425","last_fullsized":"2021-02-13 17:05:06.661425","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:05.650269","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:05.650269","last_clean_scrub_stamp":"2021-02-13 17:05:05.650269","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:06.660428","last_change":"2021-02-13 17:05:06.660428","last_active":"2021-02-13 17:05:06.660428","last_peered":"2021-02-13 17:05:06.660428","last_clean":"2021-02-13 17:05:06.660428","last_became_active":"2021-02-13 17:05:06.660210","last_became_peered":"2021-02-13 17:05:06.660210","last_unstale":"2021-02-13 17:05:06.660428","last_undegraded":"2021-02-13 17:05:06.660428","last_fullsized":"2021-02-13 17:05:06.660428","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:05.650269","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:05.650269","last_clean_scrub_stamp":"2021-02-13 17:05:05.650269","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048672,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808928,"statfs":{"total":107374182400,"available":106300342272,"internally_reserved":1073741824,"allocated":90112,"data_stored":20765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9670000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048672,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808928,"statfs":{"total":107374182400,"available":106300342272,"internally_reserved":1073741824,"allocated":90112,"data_stored":20765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2410000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.032}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048680,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808920,"statfs":{"total":107374182400,"available":106300334080,"internally_reserved":1073741824,"allocated":98304,"data_stored":23840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0270000000000001}]}]}]}} 2021-02-13T17:05:10.078 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 status --format=json-pretty 2021-02-13T17:05:10.237 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:10.237 INFO:teuthology.orchestra.run.gibba037.stdout:{ 2021-02-13T17:05:10.237 INFO:teuthology.orchestra.run.gibba037.stdout: "fsid": "611a710d-9f14-45ea-aab7-0ffef279fb6a", 2021-02-13T17:05:10.237 INFO:teuthology.orchestra.run.gibba037.stdout: "health": { 2021-02-13T17:05:10.237 INFO:teuthology.orchestra.run.gibba037.stdout: "checks": {}, 2021-02-13T17:05:10.237 INFO:teuthology.orchestra.run.gibba037.stdout: "status": "HEALTH_OK" 2021-02-13T17:05:10.237 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.238 INFO:teuthology.orchestra.run.gibba037.stdout: "election_epoch": 3, 2021-02-13T17:05:10.238 INFO:teuthology.orchestra.run.gibba037.stdout: "quorum": [ 2021-02-13T17:05:10.238 INFO:teuthology.orchestra.run.gibba037.stdout: 0 2021-02-13T17:05:10.238 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-02-13T17:05:10.238 INFO:teuthology.orchestra.run.gibba037.stdout: "quorum_names": [ 2021-02-13T17:05:10.238 INFO:teuthology.orchestra.run.gibba037.stdout: "a" 2021-02-13T17:05:10.238 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-02-13T17:05:10.238 INFO:teuthology.orchestra.run.gibba037.stdout: "quorum_age": 13, 2021-02-13T17:05:10.238 INFO:teuthology.orchestra.run.gibba037.stdout: "monmap": { 2021-02-13T17:05:10.238 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 1, 2021-02-13T17:05:10.238 INFO:teuthology.orchestra.run.gibba037.stdout: "min_mon_release_name": "14", 2021-02-13T17:05:10.238 INFO:teuthology.orchestra.run.gibba037.stdout: "num_mons": 1 2021-02-13T17:05:10.239 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.239 INFO:teuthology.orchestra.run.gibba037.stdout: "osdmap": { 2021-02-13T17:05:10.239 INFO:teuthology.orchestra.run.gibba037.stdout: "osdmap": { 2021-02-13T17:05:10.239 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 11, 2021-02-13T17:05:10.239 INFO:teuthology.orchestra.run.gibba037.stdout: "num_osds": 3, 2021-02-13T17:05:10.239 INFO:teuthology.orchestra.run.gibba037.stdout: "num_up_osds": 3, 2021-02-13T17:05:10.239 INFO:teuthology.orchestra.run.gibba037.stdout: "num_in_osds": 3, 2021-02-13T17:05:10.239 INFO:teuthology.orchestra.run.gibba037.stdout: "num_remapped_pgs": 0 2021-02-13T17:05:10.239 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.239 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.239 INFO:teuthology.orchestra.run.gibba037.stdout: "pgmap": { 2021-02-13T17:05:10.239 INFO:teuthology.orchestra.run.gibba037.stdout: "pgs_by_state": [ 2021-02-13T17:05:10.239 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.240 INFO:teuthology.orchestra.run.gibba037.stdout: "state_name": "active+clean", 2021-02-13T17:05:10.240 INFO:teuthology.orchestra.run.gibba037.stdout: "count": 8 2021-02-13T17:05:10.240 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.240 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-02-13T17:05:10.240 INFO:teuthology.orchestra.run.gibba037.stdout: "num_pgs": 8, 2021-02-13T17:05:10.240 INFO:teuthology.orchestra.run.gibba037.stdout: "num_pools": 1, 2021-02-13T17:05:10.240 INFO:teuthology.orchestra.run.gibba037.stdout: "num_objects": 0, 2021-02-13T17:05:10.240 INFO:teuthology.orchestra.run.gibba037.stdout: "data_bytes": 0, 2021-02-13T17:05:10.240 INFO:teuthology.orchestra.run.gibba037.stdout: "bytes_used": 3221528576, 2021-02-13T17:05:10.240 INFO:teuthology.orchestra.run.gibba037.stdout: "bytes_avail": 318901018624, 2021-02-13T17:05:10.240 INFO:teuthology.orchestra.run.gibba037.stdout: "bytes_total": 322122547200 2021-02-13T17:05:10.240 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.240 INFO:teuthology.orchestra.run.gibba037.stdout: "fsmap": { 2021-02-13T17:05:10.241 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 1, 2021-02-13T17:05:10.241 INFO:teuthology.orchestra.run.gibba037.stdout: "by_rank": [], 2021-02-13T17:05:10.241 INFO:teuthology.orchestra.run.gibba037.stdout: "up:standby": 0 2021-02-13T17:05:10.241 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.241 INFO:teuthology.orchestra.run.gibba037.stdout: "mgrmap": { 2021-02-13T17:05:10.241 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 3, 2021-02-13T17:05:10.241 INFO:teuthology.orchestra.run.gibba037.stdout: "active_gid": 4101, 2021-02-13T17:05:10.241 INFO:teuthology.orchestra.run.gibba037.stdout: "active_name": "x", 2021-02-13T17:05:10.241 INFO:teuthology.orchestra.run.gibba037.stdout: "active_addrs": { 2021-02-13T17:05:10.241 INFO:teuthology.orchestra.run.gibba037.stdout: "addrvec": [ 2021-02-13T17:05:10.242 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.242 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v2", 2021-02-13T17:05:10.242 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6824", 2021-02-13T17:05:10.242 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14041 2021-02-13T17:05:10.242 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.242 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.242 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "v1", 2021-02-13T17:05:10.242 INFO:teuthology.orchestra.run.gibba037.stdout: "addr": "172.21.2.137:6825", 2021-02-13T17:05:10.242 INFO:teuthology.orchestra.run.gibba037.stdout: "nonce": 14041 2021-02-13T17:05:10.242 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.243 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-02-13T17:05:10.243 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.243 INFO:teuthology.orchestra.run.gibba037.stdout: "active_addr": "172.21.2.137:6825/14041", 2021-02-13T17:05:10.243 INFO:teuthology.orchestra.run.gibba037.stdout: "active_change": "2021-02-13 17:04:58.576756", 2021-02-13T17:05:10.243 INFO:teuthology.orchestra.run.gibba037.stdout: "available": true, 2021-02-13T17:05:10.243 INFO:teuthology.orchestra.run.gibba037.stdout: "standbys": [], 2021-02-13T17:05:10.243 INFO:teuthology.orchestra.run.gibba037.stdout: "modules": [ 2021-02-13T17:05:10.243 INFO:teuthology.orchestra.run.gibba037.stdout: "iostat", 2021-02-13T17:05:10.243 INFO:teuthology.orchestra.run.gibba037.stdout: "restful" 2021-02-13T17:05:10.243 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-02-13T17:05:10.244 INFO:teuthology.orchestra.run.gibba037.stdout: "available_modules": [ 2021-02-13T17:05:10.244 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.244 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "alerts", 2021-02-13T17:05:10.244 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.245 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.245 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.245 INFO:teuthology.orchestra.run.gibba037.stdout: "interval": { 2021-02-13T17:05:10.245 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "interval", 2021-02-13T17:05:10.245 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "secs", 2021-02-13T17:05:10.245 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.245 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.245 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "60", 2021-02-13T17:05:10.245 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.245 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.245 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.246 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "How frequently to reexamine health status", 2021-02-13T17:05:10.246 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.246 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.246 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.246 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.246 INFO:teuthology.orchestra.run.gibba037.stdout: "smtp_destination": { 2021-02-13T17:05:10.247 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "smtp_destination", 2021-02-13T17:05:10.247 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.247 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.247 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.247 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.247 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.247 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.247 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.247 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "Email address to send alerts to", 2021-02-13T17:05:10.247 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.247 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.248 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.248 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.248 INFO:teuthology.orchestra.run.gibba037.stdout: "smtp_from_name": { 2021-02-13T17:05:10.248 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "smtp_from_name", 2021-02-13T17:05:10.248 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.248 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.248 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.248 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "Ceph", 2021-02-13T17:05:10.248 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.248 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.248 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.248 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "Email From: name", 2021-02-13T17:05:10.249 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.249 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.249 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.249 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.249 INFO:teuthology.orchestra.run.gibba037.stdout: "smtp_host": { 2021-02-13T17:05:10.249 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "smtp_host", 2021-02-13T17:05:10.249 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.249 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.249 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.249 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.249 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.250 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.250 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.250 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "SMTP server", 2021-02-13T17:05:10.250 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.250 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.250 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.250 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.250 INFO:teuthology.orchestra.run.gibba037.stdout: "smtp_password": { 2021-02-13T17:05:10.250 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "smtp_password", 2021-02-13T17:05:10.250 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.250 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.250 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.251 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.251 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.251 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.251 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.251 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "Password to authenticate with", 2021-02-13T17:05:10.251 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.251 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.251 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.251 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.251 INFO:teuthology.orchestra.run.gibba037.stdout: "smtp_port": { 2021-02-13T17:05:10.251 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "smtp_port", 2021-02-13T17:05:10.251 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "int", 2021-02-13T17:05:10.251 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.252 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.252 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "465", 2021-02-13T17:05:10.252 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.252 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.252 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.252 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "SMTP port", 2021-02-13T17:05:10.252 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.252 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.252 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.252 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.252 INFO:teuthology.orchestra.run.gibba037.stdout: "smtp_sender": { 2021-02-13T17:05:10.252 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "smtp_sender", 2021-02-13T17:05:10.252 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.253 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.253 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.253 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.253 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.253 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.253 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.253 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "SMTP envelope sender", 2021-02-13T17:05:10.253 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.253 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.253 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.253 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.253 INFO:teuthology.orchestra.run.gibba037.stdout: "smtp_ssl": { 2021-02-13T17:05:10.254 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "smtp_ssl", 2021-02-13T17:05:10.254 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.254 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.254 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.254 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "True", 2021-02-13T17:05:10.254 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.254 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.254 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.254 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "Use SSL to connect to SMTP server", 2021-02-13T17:05:10.254 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.254 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.254 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.255 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.255 INFO:teuthology.orchestra.run.gibba037.stdout: "smtp_user": { 2021-02-13T17:05:10.255 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "smtp_user", 2021-02-13T17:05:10.255 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.255 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.255 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.255 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.255 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.255 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.255 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.255 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "User to authenticate as", 2021-02-13T17:05:10.256 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.256 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.256 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.256 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.256 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.256 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.256 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.256 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "ansible", 2021-02-13T17:05:10.256 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.256 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.257 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.257 INFO:teuthology.orchestra.run.gibba037.stdout: "password": { 2021-02-13T17:05:10.257 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "password", 2021-02-13T17:05:10.257 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.257 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.257 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.257 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.257 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.257 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.257 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.257 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.257 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.257 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.257 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.258 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.258 INFO:teuthology.orchestra.run.gibba037.stdout: "server_url": { 2021-02-13T17:05:10.258 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "server_url", 2021-02-13T17:05:10.258 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.258 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.258 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.258 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.258 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.258 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.258 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.258 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.258 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.259 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.259 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.259 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.259 INFO:teuthology.orchestra.run.gibba037.stdout: "username": { 2021-02-13T17:05:10.259 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "username", 2021-02-13T17:05:10.259 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.259 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.259 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.259 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.260 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.260 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.260 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.260 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.260 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.260 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.260 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.260 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.260 INFO:teuthology.orchestra.run.gibba037.stdout: "verify_server": { 2021-02-13T17:05:10.260 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "verify_server", 2021-02-13T17:05:10.260 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.260 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.260 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.261 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.261 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.261 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.261 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.261 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.261 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.261 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.261 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.261 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.261 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.261 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.261 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.261 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "balancer", 2021-02-13T17:05:10.262 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.262 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.262 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.262 INFO:teuthology.orchestra.run.gibba037.stdout: "active": { 2021-02-13T17:05:10.262 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "active", 2021-02-13T17:05:10.262 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.262 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.262 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.262 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "False", 2021-02-13T17:05:10.262 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.262 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.262 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.263 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "automatically balance PGs across cluster", 2021-02-13T17:05:10.263 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.263 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.263 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.263 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.263 INFO:teuthology.orchestra.run.gibba037.stdout: "begin_time": { 2021-02-13T17:05:10.263 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "begin_time", 2021-02-13T17:05:10.263 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.263 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.263 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.263 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "0000", 2021-02-13T17:05:10.264 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.264 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.264 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.264 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "beginning time of day to automatically balance", 2021-02-13T17:05:10.264 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-02-13T17:05:10.264 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.264 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.264 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.264 INFO:teuthology.orchestra.run.gibba037.stdout: "begin_weekday": { 2021-02-13T17:05:10.264 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "begin_weekday", 2021-02-13T17:05:10.264 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "uint", 2021-02-13T17:05:10.265 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.265 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.265 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "0", 2021-02-13T17:05:10.265 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "0", 2021-02-13T17:05:10.265 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "7", 2021-02-13T17:05:10.265 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.266 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2021-02-13T17:05:10.266 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-02-13T17:05:10.266 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.266 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.267 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.267 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_compat_max_iterations": { 2021-02-13T17:05:10.267 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "crush_compat_max_iterations", 2021-02-13T17:05:10.267 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "uint", 2021-02-13T17:05:10.267 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.267 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.268 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "25", 2021-02-13T17:05:10.268 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "1", 2021-02-13T17:05:10.268 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "250", 2021-02-13T17:05:10.268 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.268 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "maximum number of iterations to attempt optimization", 2021-02-13T17:05:10.268 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.268 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.268 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.268 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.268 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_compat_metrics": { 2021-02-13T17:05:10.268 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "crush_compat_metrics", 2021-02-13T17:05:10.268 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.268 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.268 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.269 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "pgs,objects,bytes", 2021-02-13T17:05:10.269 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.269 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.269 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.269 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "metrics with which to calculate OSD utilization", 2021-02-13T17:05:10.269 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-02-13T17:05:10.269 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.269 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.269 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.269 INFO:teuthology.orchestra.run.gibba037.stdout: "crush_compat_step": { 2021-02-13T17:05:10.269 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "crush_compat_step", 2021-02-13T17:05:10.269 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "float", 2021-02-13T17:05:10.269 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.270 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.270 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "0.5", 2021-02-13T17:05:10.270 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "0.001", 2021-02-13T17:05:10.270 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "0.999", 2021-02-13T17:05:10.270 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.270 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "aggressiveness of optimization", 2021-02-13T17:05:10.270 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-02-13T17:05:10.270 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.270 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.270 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.270 INFO:teuthology.orchestra.run.gibba037.stdout: "end_time": { 2021-02-13T17:05:10.270 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "end_time", 2021-02-13T17:05:10.270 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.271 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.271 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.271 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "2400", 2021-02-13T17:05:10.271 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.271 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.271 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.271 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "ending time of day to automatically balance", 2021-02-13T17:05:10.271 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-02-13T17:05:10.271 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.271 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.271 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.271 INFO:teuthology.orchestra.run.gibba037.stdout: "end_weekday": { 2021-02-13T17:05:10.271 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "end_weekday", 2021-02-13T17:05:10.271 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "uint", 2021-02-13T17:05:10.272 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.272 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.272 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "7", 2021-02-13T17:05:10.272 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "0", 2021-02-13T17:05:10.272 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "7", 2021-02-13T17:05:10.272 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.272 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-02-13T17:05:10.272 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-02-13T17:05:10.272 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.273 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.273 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.273 INFO:teuthology.orchestra.run.gibba037.stdout: "min_score": { 2021-02-13T17:05:10.273 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "min_score", 2021-02-13T17:05:10.273 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "float", 2021-02-13T17:05:10.273 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.274 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.274 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "0", 2021-02-13T17:05:10.274 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.274 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.274 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.274 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "minimum score, below which no optimization is attempted", 2021-02-13T17:05:10.275 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.275 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.275 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.275 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.275 INFO:teuthology.orchestra.run.gibba037.stdout: "mode": { 2021-02-13T17:05:10.275 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "mode", 2021-02-13T17:05:10.276 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.276 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.276 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.276 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "none", 2021-02-13T17:05:10.276 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.276 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.276 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [ 2021-02-13T17:05:10.276 INFO:teuthology.orchestra.run.gibba037.stdout: "crush-compat", 2021-02-13T17:05:10.277 INFO:teuthology.orchestra.run.gibba037.stdout: "none", 2021-02-13T17:05:10.277 INFO:teuthology.orchestra.run.gibba037.stdout: "upmap" 2021-02-13T17:05:10.277 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-02-13T17:05:10.277 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "Balancer mode", 2021-02-13T17:05:10.277 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.277 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.277 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.278 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.278 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_ids": { 2021-02-13T17:05:10.278 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "pool_ids", 2021-02-13T17:05:10.278 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.278 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.278 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.279 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.279 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.279 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.279 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.279 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "pools which the automatic balancing will be limited to", 2021-02-13T17:05:10.279 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.279 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.279 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.279 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.279 INFO:teuthology.orchestra.run.gibba037.stdout: "sleep_interval": { 2021-02-13T17:05:10.279 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "sleep_interval", 2021-02-13T17:05:10.280 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "secs", 2021-02-13T17:05:10.280 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.280 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.280 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "60", 2021-02-13T17:05:10.280 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.280 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.280 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.280 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "how frequently to wake up and attempt optimization", 2021-02-13T17:05:10.280 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.280 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.281 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.281 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.281 INFO:teuthology.orchestra.run.gibba037.stdout: "upmap_max_deviation": { 2021-02-13T17:05:10.281 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "upmap_max_deviation", 2021-02-13T17:05:10.281 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "int", 2021-02-13T17:05:10.281 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.281 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.281 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "5", 2021-02-13T17:05:10.281 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "1", 2021-02-13T17:05:10.281 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.281 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.281 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "deviation below which no optimization is attempted", 2021-02-13T17:05:10.281 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-02-13T17:05:10.282 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.282 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.282 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.282 INFO:teuthology.orchestra.run.gibba037.stdout: "upmap_max_iterations": { 2021-02-13T17:05:10.282 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "upmap_max_iterations", 2021-02-13T17:05:10.282 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "uint", 2021-02-13T17:05:10.282 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.282 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.282 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "10", 2021-02-13T17:05:10.282 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.282 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.282 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.283 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "maximum upmap optimization iterations", 2021-02-13T17:05:10.283 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.283 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.283 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.283 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.283 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.283 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.283 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.283 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "crash", 2021-02-13T17:05:10.283 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.283 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.284 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.284 INFO:teuthology.orchestra.run.gibba037.stdout: "retain_interval": { 2021-02-13T17:05:10.284 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "retain_interval", 2021-02-13T17:05:10.284 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "secs", 2021-02-13T17:05:10.284 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.284 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.284 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "31536000", 2021-02-13T17:05:10.284 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.284 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.284 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.284 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "how long to retain crashes before pruning them", 2021-02-13T17:05:10.284 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.284 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.284 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.285 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.285 INFO:teuthology.orchestra.run.gibba037.stdout: "warn_recent_interval": { 2021-02-13T17:05:10.285 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "warn_recent_interval", 2021-02-13T17:05:10.285 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "secs", 2021-02-13T17:05:10.285 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.285 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.285 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "1209600", 2021-02-13T17:05:10.285 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.285 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.285 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.285 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "time interval in which to warn about recent crashes", 2021-02-13T17:05:10.285 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.285 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.286 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.286 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.286 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.286 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.286 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.286 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "dashboard", 2021-02-13T17:05:10.286 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.286 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.286 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.286 INFO:teuthology.orchestra.run.gibba037.stdout: "ALERTMANAGER_API_HOST": { 2021-02-13T17:05:10.286 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "ALERTMANAGER_API_HOST", 2021-02-13T17:05:10.286 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.286 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.287 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.287 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.287 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.287 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.287 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.287 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.287 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.287 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.287 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.287 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.287 INFO:teuthology.orchestra.run.gibba037.stdout: "AUDIT_API_ENABLED": { 2021-02-13T17:05:10.288 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "AUDIT_API_ENABLED", 2021-02-13T17:05:10.288 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.288 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.288 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.288 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "False", 2021-02-13T17:05:10.288 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.288 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.288 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.288 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.288 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.288 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.288 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.289 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.289 INFO:teuthology.orchestra.run.gibba037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2021-02-13T17:05:10.289 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2021-02-13T17:05:10.289 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.289 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.289 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.289 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "True", 2021-02-13T17:05:10.289 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.289 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.289 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.289 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.290 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.290 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.290 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.290 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.290 INFO:teuthology.orchestra.run.gibba037.stdout: "ENABLE_BROWSABLE_API": { 2021-02-13T17:05:10.290 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "ENABLE_BROWSABLE_API", 2021-02-13T17:05:10.290 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.290 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.290 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.290 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "True", 2021-02-13T17:05:10.290 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.291 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.291 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.291 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.291 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.291 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.291 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.291 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.291 INFO:teuthology.orchestra.run.gibba037.stdout: "FEATURE_TOGGLE_cephfs": { 2021-02-13T17:05:10.291 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "FEATURE_TOGGLE_cephfs", 2021-02-13T17:05:10.291 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.291 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.291 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.291 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "True", 2021-02-13T17:05:10.291 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.292 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.292 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.292 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.292 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.292 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.292 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.292 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.292 INFO:teuthology.orchestra.run.gibba037.stdout: "FEATURE_TOGGLE_iscsi": { 2021-02-13T17:05:10.292 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "FEATURE_TOGGLE_iscsi", 2021-02-13T17:05:10.292 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.293 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.293 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.293 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "True", 2021-02-13T17:05:10.293 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.293 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.293 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.294 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.294 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.294 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.294 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.294 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.294 INFO:teuthology.orchestra.run.gibba037.stdout: "FEATURE_TOGGLE_mirroring": { 2021-02-13T17:05:10.295 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "FEATURE_TOGGLE_mirroring", 2021-02-13T17:05:10.295 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.295 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.295 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.295 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "True", 2021-02-13T17:05:10.295 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.295 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.296 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.296 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.296 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.296 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.296 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.296 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.296 INFO:teuthology.orchestra.run.gibba037.stdout: "FEATURE_TOGGLE_rbd": { 2021-02-13T17:05:10.296 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "FEATURE_TOGGLE_rbd", 2021-02-13T17:05:10.297 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.297 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.297 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.297 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "True", 2021-02-13T17:05:10.297 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.297 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.297 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.297 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.297 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.298 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.298 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.298 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.298 INFO:teuthology.orchestra.run.gibba037.stdout: "FEATURE_TOGGLE_rgw": { 2021-02-13T17:05:10.298 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "FEATURE_TOGGLE_rgw", 2021-02-13T17:05:10.298 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.298 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.299 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.299 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "True", 2021-02-13T17:05:10.299 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.299 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.299 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.299 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.299 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.299 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.300 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.300 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.300 INFO:teuthology.orchestra.run.gibba037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-02-13T17:05:10.300 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-02-13T17:05:10.300 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.300 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.300 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.300 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.301 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.301 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.301 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.301 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.301 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.301 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.301 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.301 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.301 INFO:teuthology.orchestra.run.gibba037.stdout: "GRAFANA_API_PASSWORD": { 2021-02-13T17:05:10.301 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "GRAFANA_API_PASSWORD", 2021-02-13T17:05:10.301 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.302 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.302 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.302 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "admin", 2021-02-13T17:05:10.302 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.302 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.302 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.302 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.302 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.302 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.302 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.302 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.303 INFO:teuthology.orchestra.run.gibba037.stdout: "GRAFANA_API_SSL_VERIFY": { 2021-02-13T17:05:10.303 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2021-02-13T17:05:10.303 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.303 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.303 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.303 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "True", 2021-02-13T17:05:10.303 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.303 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.303 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.303 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.303 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.303 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.303 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.304 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.304 INFO:teuthology.orchestra.run.gibba037.stdout: "GRAFANA_API_URL": { 2021-02-13T17:05:10.304 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "GRAFANA_API_URL", 2021-02-13T17:05:10.304 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.304 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.304 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.304 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.304 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.304 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.304 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.304 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.304 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.304 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.305 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.305 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.305 INFO:teuthology.orchestra.run.gibba037.stdout: "GRAFANA_API_USERNAME": { 2021-02-13T17:05:10.305 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "GRAFANA_API_USERNAME", 2021-02-13T17:05:10.305 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.305 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.305 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.305 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "admin", 2021-02-13T17:05:10.305 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.305 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.305 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.306 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.306 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.306 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.306 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.306 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.306 INFO:teuthology.orchestra.run.gibba037.stdout: "GRAFANA_FRONTEND_API_URL": { 2021-02-13T17:05:10.306 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2021-02-13T17:05:10.306 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.306 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.306 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.306 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.306 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.306 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.307 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.307 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.307 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.307 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.307 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.307 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.307 INFO:teuthology.orchestra.run.gibba037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2021-02-13T17:05:10.307 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-02-13T17:05:10.307 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.307 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.307 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.307 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "False", 2021-02-13T17:05:10.307 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.308 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.308 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.308 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.308 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.308 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.308 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.308 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.308 INFO:teuthology.orchestra.run.gibba037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2021-02-13T17:05:10.308 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2021-02-13T17:05:10.308 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.308 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.308 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.308 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "True", 2021-02-13T17:05:10.309 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.309 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.309 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.309 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.309 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.309 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.309 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.309 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.309 INFO:teuthology.orchestra.run.gibba037.stdout: "PROMETHEUS_API_HOST": { 2021-02-13T17:05:10.309 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "PROMETHEUS_API_HOST", 2021-02-13T17:05:10.309 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.309 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.310 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.310 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.310 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.310 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.310 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.310 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.310 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.310 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.310 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.310 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.310 INFO:teuthology.orchestra.run.gibba037.stdout: "REST_REQUESTS_TIMEOUT": { 2021-02-13T17:05:10.310 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2021-02-13T17:05:10.311 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "int", 2021-02-13T17:05:10.311 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.311 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.311 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "45", 2021-02-13T17:05:10.311 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.311 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.311 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.311 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.311 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.311 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.311 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.311 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.311 INFO:teuthology.orchestra.run.gibba037.stdout: "RGW_API_ACCESS_KEY": { 2021-02-13T17:05:10.311 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "RGW_API_ACCESS_KEY", 2021-02-13T17:05:10.312 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.312 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.312 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.312 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.312 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.312 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.312 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.312 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.312 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.312 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.312 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.312 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.312 INFO:teuthology.orchestra.run.gibba037.stdout: "RGW_API_ADMIN_RESOURCE": { 2021-02-13T17:05:10.312 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2021-02-13T17:05:10.313 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.313 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.313 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.313 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "admin", 2021-02-13T17:05:10.313 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.313 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.313 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.313 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.313 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.314 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.314 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.314 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.314 INFO:teuthology.orchestra.run.gibba037.stdout: "RGW_API_HOST": { 2021-02-13T17:05:10.314 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "RGW_API_HOST", 2021-02-13T17:05:10.314 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.315 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.315 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.315 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.315 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.315 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.316 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.316 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.316 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.316 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.316 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.316 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.317 INFO:teuthology.orchestra.run.gibba037.stdout: "RGW_API_PORT": { 2021-02-13T17:05:10.317 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "RGW_API_PORT", 2021-02-13T17:05:10.317 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "int", 2021-02-13T17:05:10.317 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.317 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.317 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "80", 2021-02-13T17:05:10.318 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.318 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.318 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.318 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.318 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.319 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.319 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.319 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.319 INFO:teuthology.orchestra.run.gibba037.stdout: "RGW_API_SCHEME": { 2021-02-13T17:05:10.319 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "RGW_API_SCHEME", 2021-02-13T17:05:10.319 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.320 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.320 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.320 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "http", 2021-02-13T17:05:10.320 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.320 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.321 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.321 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.321 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.321 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.321 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.321 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.322 INFO:teuthology.orchestra.run.gibba037.stdout: "RGW_API_SECRET_KEY": { 2021-02-13T17:05:10.322 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "RGW_API_SECRET_KEY", 2021-02-13T17:05:10.322 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.322 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.322 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.322 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.323 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.323 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.323 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.323 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.323 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.323 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.324 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.324 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.324 INFO:teuthology.orchestra.run.gibba037.stdout: "RGW_API_SSL_VERIFY": { 2021-02-13T17:05:10.324 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "RGW_API_SSL_VERIFY", 2021-02-13T17:05:10.324 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.324 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.325 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.325 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "True", 2021-02-13T17:05:10.325 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.325 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.325 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.325 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.325 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.325 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.325 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.325 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.325 INFO:teuthology.orchestra.run.gibba037.stdout: "RGW_API_USER_ID": { 2021-02-13T17:05:10.325 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "RGW_API_USER_ID", 2021-02-13T17:05:10.325 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.326 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.326 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.326 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.326 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.326 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.326 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.326 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.326 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.326 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.326 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.326 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.326 INFO:teuthology.orchestra.run.gibba037.stdout: "crt_file": { 2021-02-13T17:05:10.326 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "crt_file", 2021-02-13T17:05:10.327 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.327 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.327 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.327 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.327 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.327 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.327 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.327 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.327 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.327 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.327 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.327 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.327 INFO:teuthology.orchestra.run.gibba037.stdout: "debug": { 2021-02-13T17:05:10.327 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "debug", 2021-02-13T17:05:10.328 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.328 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.328 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.328 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "False", 2021-02-13T17:05:10.328 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.328 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.328 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.328 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "Enable/disable debug options", 2021-02-13T17:05:10.328 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.328 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.328 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.328 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.328 INFO:teuthology.orchestra.run.gibba037.stdout: "jwt_token_ttl": { 2021-02-13T17:05:10.328 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "jwt_token_ttl", 2021-02-13T17:05:10.329 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "int", 2021-02-13T17:05:10.329 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.329 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.329 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "28800", 2021-02-13T17:05:10.329 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.329 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.329 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.329 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.329 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.329 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.329 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.329 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.329 INFO:teuthology.orchestra.run.gibba037.stdout: "key_file": { 2021-02-13T17:05:10.329 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "key_file", 2021-02-13T17:05:10.330 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.330 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.330 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.330 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.330 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.330 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.330 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.330 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.330 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.330 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.330 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.330 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.330 INFO:teuthology.orchestra.run.gibba037.stdout: "password": { 2021-02-13T17:05:10.331 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "password", 2021-02-13T17:05:10.331 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.331 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.331 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.331 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.331 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.331 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.331 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.331 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.331 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.331 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.331 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.331 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.331 INFO:teuthology.orchestra.run.gibba037.stdout: "server_addr": { 2021-02-13T17:05:10.332 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "server_addr", 2021-02-13T17:05:10.332 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.332 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.332 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.332 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "::", 2021-02-13T17:05:10.332 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.332 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.332 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.332 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.332 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.332 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.332 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.333 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.333 INFO:teuthology.orchestra.run.gibba037.stdout: "server_port": { 2021-02-13T17:05:10.333 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "server_port", 2021-02-13T17:05:10.333 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "int", 2021-02-13T17:05:10.333 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.333 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.333 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "8080", 2021-02-13T17:05:10.333 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.333 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.333 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.333 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.334 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.334 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.334 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.334 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.334 INFO:teuthology.orchestra.run.gibba037.stdout: "ssl": { 2021-02-13T17:05:10.334 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "ssl", 2021-02-13T17:05:10.334 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.334 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.334 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.334 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "True", 2021-02-13T17:05:10.334 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.334 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.335 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.335 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.335 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.335 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.335 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.335 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.335 INFO:teuthology.orchestra.run.gibba037.stdout: "ssl_server_port": { 2021-02-13T17:05:10.335 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "ssl_server_port", 2021-02-13T17:05:10.335 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "int", 2021-02-13T17:05:10.335 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.335 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.335 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "8443", 2021-02-13T17:05:10.335 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.335 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.336 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.336 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.336 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.336 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.336 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.336 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.336 INFO:teuthology.orchestra.run.gibba037.stdout: "standby_behaviour": { 2021-02-13T17:05:10.336 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "standby_behaviour", 2021-02-13T17:05:10.336 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.336 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.336 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.336 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "redirect", 2021-02-13T17:05:10.336 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.336 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.337 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [ 2021-02-13T17:05:10.337 INFO:teuthology.orchestra.run.gibba037.stdout: "error", 2021-02-13T17:05:10.337 INFO:teuthology.orchestra.run.gibba037.stdout: "redirect" 2021-02-13T17:05:10.337 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-02-13T17:05:10.337 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.337 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.337 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.337 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.337 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.337 INFO:teuthology.orchestra.run.gibba037.stdout: "standby_error_status_code": { 2021-02-13T17:05:10.337 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "standby_error_status_code", 2021-02-13T17:05:10.337 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "int", 2021-02-13T17:05:10.337 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.337 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.338 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "500", 2021-02-13T17:05:10.338 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "400", 2021-02-13T17:05:10.338 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "599", 2021-02-13T17:05:10.338 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.338 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.338 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.338 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.338 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.338 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.338 INFO:teuthology.orchestra.run.gibba037.stdout: "url_prefix": { 2021-02-13T17:05:10.338 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "url_prefix", 2021-02-13T17:05:10.338 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.338 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.339 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.339 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.339 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.339 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.339 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.339 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.339 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.339 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.339 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.339 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.339 INFO:teuthology.orchestra.run.gibba037.stdout: "username": { 2021-02-13T17:05:10.339 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "username", 2021-02-13T17:05:10.339 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.340 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.340 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.340 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.340 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.340 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.340 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.340 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.340 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.340 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.340 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.340 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.340 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.340 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.340 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.341 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "deepsea", 2021-02-13T17:05:10.341 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.341 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.341 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.341 INFO:teuthology.orchestra.run.gibba037.stdout: "salt_api_eauth": { 2021-02-13T17:05:10.341 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "salt_api_eauth", 2021-02-13T17:05:10.341 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.341 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.341 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.341 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "sharedsecret", 2021-02-13T17:05:10.341 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.341 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.341 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.342 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.342 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.342 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.342 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.342 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.342 INFO:teuthology.orchestra.run.gibba037.stdout: "salt_api_password": { 2021-02-13T17:05:10.342 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "salt_api_password", 2021-02-13T17:05:10.342 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.342 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.342 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.342 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.342 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.342 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.343 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.343 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.343 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.343 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.343 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.343 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.343 INFO:teuthology.orchestra.run.gibba037.stdout: "salt_api_url": { 2021-02-13T17:05:10.343 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "salt_api_url", 2021-02-13T17:05:10.343 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.343 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.343 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.343 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.343 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.343 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.343 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.344 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.344 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.344 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.344 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.344 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.344 INFO:teuthology.orchestra.run.gibba037.stdout: "salt_api_username": { 2021-02-13T17:05:10.344 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "salt_api_username", 2021-02-13T17:05:10.344 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.344 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.344 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.344 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.344 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.344 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.345 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.345 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.345 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.345 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.345 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.345 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.345 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.345 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.345 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.345 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "devicehealth", 2021-02-13T17:05:10.345 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.345 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.345 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.345 INFO:teuthology.orchestra.run.gibba037.stdout: "enable_monitoring": { 2021-02-13T17:05:10.346 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "enable_monitoring", 2021-02-13T17:05:10.346 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.346 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.346 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.346 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "False", 2021-02-13T17:05:10.346 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.346 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.346 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.346 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "monitor device health metrics", 2021-02-13T17:05:10.346 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.346 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.346 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.346 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.346 INFO:teuthology.orchestra.run.gibba037.stdout: "mark_out_threshold": { 2021-02-13T17:05:10.347 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "mark_out_threshold", 2021-02-13T17:05:10.347 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "secs", 2021-02-13T17:05:10.347 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.347 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.347 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "2419200", 2021-02-13T17:05:10.347 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.347 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.347 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.347 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2021-02-13T17:05:10.347 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.347 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.347 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.347 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.348 INFO:teuthology.orchestra.run.gibba037.stdout: "pool_name": { 2021-02-13T17:05:10.348 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "pool_name", 2021-02-13T17:05:10.348 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.348 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.348 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.348 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "device_health_metrics", 2021-02-13T17:05:10.348 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.348 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.348 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.348 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "name of pool in which to store device health metrics", 2021-02-13T17:05:10.348 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.348 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.348 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.348 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.349 INFO:teuthology.orchestra.run.gibba037.stdout: "retention_period": { 2021-02-13T17:05:10.349 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "retention_period", 2021-02-13T17:05:10.349 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "secs", 2021-02-13T17:05:10.349 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.349 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.349 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "15552000", 2021-02-13T17:05:10.349 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.349 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.349 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.349 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "how long to retain device health metrics", 2021-02-13T17:05:10.349 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.349 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.349 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.349 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.350 INFO:teuthology.orchestra.run.gibba037.stdout: "scrape_frequency": { 2021-02-13T17:05:10.350 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "scrape_frequency", 2021-02-13T17:05:10.350 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "secs", 2021-02-13T17:05:10.350 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.350 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.350 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "86400", 2021-02-13T17:05:10.350 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.350 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.350 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.350 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "how frequently to scrape device health metrics", 2021-02-13T17:05:10.350 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.350 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.350 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.350 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.351 INFO:teuthology.orchestra.run.gibba037.stdout: "self_heal": { 2021-02-13T17:05:10.351 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "self_heal", 2021-02-13T17:05:10.351 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.351 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.351 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.351 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "True", 2021-02-13T17:05:10.351 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.351 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.351 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.351 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2021-02-13T17:05:10.351 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.351 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.351 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.351 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.352 INFO:teuthology.orchestra.run.gibba037.stdout: "sleep_interval": { 2021-02-13T17:05:10.352 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "sleep_interval", 2021-02-13T17:05:10.352 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "secs", 2021-02-13T17:05:10.352 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.352 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.352 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "600", 2021-02-13T17:05:10.352 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.352 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.352 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.352 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "how frequently to wake up and check device health", 2021-02-13T17:05:10.352 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.352 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.352 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.353 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.353 INFO:teuthology.orchestra.run.gibba037.stdout: "warn_threshold": { 2021-02-13T17:05:10.353 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "warn_threshold", 2021-02-13T17:05:10.353 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "secs", 2021-02-13T17:05:10.353 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.353 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.353 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "7257600", 2021-02-13T17:05:10.353 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.353 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.353 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.353 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "raise health warning if OSD may fail before this long", 2021-02-13T17:05:10.353 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.353 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.354 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.354 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.354 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.354 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.354 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.354 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "diskprediction_cloud", 2021-02-13T17:05:10.354 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.354 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.354 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.354 INFO:teuthology.orchestra.run.gibba037.stdout: "diskprediction_cert_context": { 2021-02-13T17:05:10.354 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "diskprediction_cert_context", 2021-02-13T17:05:10.354 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.354 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.354 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.355 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.355 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.355 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.355 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.355 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.355 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.355 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.355 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.355 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.355 INFO:teuthology.orchestra.run.gibba037.stdout: "diskprediction_default_authority": { 2021-02-13T17:05:10.355 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "diskprediction_default_authority", 2021-02-13T17:05:10.355 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.355 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.355 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.356 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "localhost", 2021-02-13T17:05:10.356 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.356 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.356 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.356 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.356 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.356 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.356 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.356 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.356 INFO:teuthology.orchestra.run.gibba037.stdout: "diskprediction_password": { 2021-02-13T17:05:10.356 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "diskprediction_password", 2021-02-13T17:05:10.356 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.356 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.356 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.357 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.357 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.357 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.357 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.357 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.357 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.357 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.357 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.357 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.357 INFO:teuthology.orchestra.run.gibba037.stdout: "diskprediction_port": { 2021-02-13T17:05:10.357 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "diskprediction_port", 2021-02-13T17:05:10.357 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.357 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.357 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.358 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "31400", 2021-02-13T17:05:10.358 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.358 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.358 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.358 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.358 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.358 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.358 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.358 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.358 INFO:teuthology.orchestra.run.gibba037.stdout: "diskprediction_retrieve_prediction_interval": { 2021-02-13T17:05:10.358 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "diskprediction_retrieve_prediction_interval", 2021-02-13T17:05:10.358 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.358 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.358 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.359 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "43200", 2021-02-13T17:05:10.359 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.359 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.359 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.359 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.359 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.359 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.359 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.359 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.359 INFO:teuthology.orchestra.run.gibba037.stdout: "diskprediction_server": { 2021-02-13T17:05:10.359 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "diskprediction_server", 2021-02-13T17:05:10.359 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.359 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.359 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.360 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.360 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.360 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.360 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.360 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.360 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.360 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.360 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.360 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.360 INFO:teuthology.orchestra.run.gibba037.stdout: "diskprediction_ssl_target_name_override": { 2021-02-13T17:05:10.360 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "diskprediction_ssl_target_name_override", 2021-02-13T17:05:10.360 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.360 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.360 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.361 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "localhost", 2021-02-13T17:05:10.361 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.361 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.361 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.361 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.361 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.361 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.361 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.361 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.361 INFO:teuthology.orchestra.run.gibba037.stdout: "diskprediction_upload_metrics_interval": { 2021-02-13T17:05:10.361 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "diskprediction_upload_metrics_interval", 2021-02-13T17:05:10.361 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.361 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.361 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.362 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "600", 2021-02-13T17:05:10.362 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.362 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.362 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.362 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.362 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.362 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.362 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.362 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.362 INFO:teuthology.orchestra.run.gibba037.stdout: "diskprediction_upload_smart_interval": { 2021-02-13T17:05:10.362 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "diskprediction_upload_smart_interval", 2021-02-13T17:05:10.362 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.362 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.363 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.363 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "43200", 2021-02-13T17:05:10.363 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.363 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.363 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.363 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.363 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.363 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.363 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.363 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.363 INFO:teuthology.orchestra.run.gibba037.stdout: "diskprediction_user": { 2021-02-13T17:05:10.363 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "diskprediction_user", 2021-02-13T17:05:10.363 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.363 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.364 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.364 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.364 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.364 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.364 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.364 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.364 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.364 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.364 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.364 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.364 INFO:teuthology.orchestra.run.gibba037.stdout: "sleep_interval": { 2021-02-13T17:05:10.364 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "sleep_interval", 2021-02-13T17:05:10.364 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.364 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.365 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.365 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "600", 2021-02-13T17:05:10.365 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.365 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.365 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.365 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.365 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.365 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.365 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.365 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.365 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.365 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.365 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.365 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "diskprediction_local", 2021-02-13T17:05:10.366 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.366 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.366 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.366 INFO:teuthology.orchestra.run.gibba037.stdout: "predict_interval": { 2021-02-13T17:05:10.366 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "predict_interval", 2021-02-13T17:05:10.366 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.366 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.366 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.366 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "86400", 2021-02-13T17:05:10.366 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.366 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.366 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.366 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.367 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.367 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.367 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.367 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.367 INFO:teuthology.orchestra.run.gibba037.stdout: "sleep_interval": { 2021-02-13T17:05:10.367 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "sleep_interval", 2021-02-13T17:05:10.367 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.367 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.367 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.367 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "600", 2021-02-13T17:05:10.367 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.367 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.367 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.367 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.368 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.368 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.368 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.368 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.368 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.368 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.368 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.368 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "influx", 2021-02-13T17:05:10.368 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": false, 2021-02-13T17:05:10.368 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "influxdb python module not found", 2021-02-13T17:05:10.368 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.368 INFO:teuthology.orchestra.run.gibba037.stdout: "batch_size": { 2021-02-13T17:05:10.368 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "batch_size", 2021-02-13T17:05:10.368 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.369 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.369 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.369 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "5000", 2021-02-13T17:05:10.369 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.369 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.369 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.369 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.369 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.369 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.369 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.369 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.369 INFO:teuthology.orchestra.run.gibba037.stdout: "database": { 2021-02-13T17:05:10.369 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "database", 2021-02-13T17:05:10.370 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.370 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.370 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.370 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "ceph", 2021-02-13T17:05:10.370 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.370 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.370 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.370 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.370 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.370 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.370 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.370 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.370 INFO:teuthology.orchestra.run.gibba037.stdout: "hostname": { 2021-02-13T17:05:10.370 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "hostname", 2021-02-13T17:05:10.371 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.371 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.371 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.371 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "None", 2021-02-13T17:05:10.371 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.371 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.371 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.371 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.371 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.371 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.371 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.371 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.371 INFO:teuthology.orchestra.run.gibba037.stdout: "interval": { 2021-02-13T17:05:10.371 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "interval", 2021-02-13T17:05:10.372 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.372 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.372 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.372 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "30", 2021-02-13T17:05:10.372 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.372 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.372 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.372 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.372 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.372 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.372 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.372 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.372 INFO:teuthology.orchestra.run.gibba037.stdout: "password": { 2021-02-13T17:05:10.372 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "password", 2021-02-13T17:05:10.373 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.373 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.373 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.373 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "None", 2021-02-13T17:05:10.373 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.373 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.373 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.373 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.373 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.373 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.373 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.373 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.373 INFO:teuthology.orchestra.run.gibba037.stdout: "port": { 2021-02-13T17:05:10.373 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "port", 2021-02-13T17:05:10.374 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.374 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.374 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.374 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "8086", 2021-02-13T17:05:10.374 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.374 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.374 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.374 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.374 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.374 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.374 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.374 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.374 INFO:teuthology.orchestra.run.gibba037.stdout: "ssl": { 2021-02-13T17:05:10.375 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "ssl", 2021-02-13T17:05:10.375 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.375 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.375 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.375 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "false", 2021-02-13T17:05:10.375 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.375 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.375 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.375 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.375 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.375 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.375 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.375 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.375 INFO:teuthology.orchestra.run.gibba037.stdout: "threads": { 2021-02-13T17:05:10.375 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "threads", 2021-02-13T17:05:10.376 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.376 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.376 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.376 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "5", 2021-02-13T17:05:10.376 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.376 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.376 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.376 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.376 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.376 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.376 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.376 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.376 INFO:teuthology.orchestra.run.gibba037.stdout: "username": { 2021-02-13T17:05:10.376 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "username", 2021-02-13T17:05:10.377 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.377 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.377 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.377 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "None", 2021-02-13T17:05:10.377 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.377 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.377 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.377 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.377 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.377 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.377 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.377 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.377 INFO:teuthology.orchestra.run.gibba037.stdout: "verify_ssl": { 2021-02-13T17:05:10.378 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "verify_ssl", 2021-02-13T17:05:10.378 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.378 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.378 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.378 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "true", 2021-02-13T17:05:10.378 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.378 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.378 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.378 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.378 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.378 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.378 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.378 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.378 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.379 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.379 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.379 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "insights", 2021-02-13T17:05:10.379 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.379 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.379 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": {} 2021-02-13T17:05:10.379 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.379 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.379 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "iostat", 2021-02-13T17:05:10.379 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.379 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.379 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": {} 2021-02-13T17:05:10.379 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.379 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.380 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "localpool", 2021-02-13T17:05:10.380 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.380 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.380 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.380 INFO:teuthology.orchestra.run.gibba037.stdout: "failure_domain": { 2021-02-13T17:05:10.380 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "failure_domain", 2021-02-13T17:05:10.380 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.380 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.380 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.380 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "host", 2021-02-13T17:05:10.380 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.380 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.380 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.380 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "failure domain for any created local pool", 2021-02-13T17:05:10.381 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.381 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.381 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.381 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.381 INFO:teuthology.orchestra.run.gibba037.stdout: "min_size": { 2021-02-13T17:05:10.381 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "min_size", 2021-02-13T17:05:10.381 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "int", 2021-02-13T17:05:10.381 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.381 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.381 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.381 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.381 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.381 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.381 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "default min_size for any created local pool", 2021-02-13T17:05:10.382 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.382 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.382 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.382 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.382 INFO:teuthology.orchestra.run.gibba037.stdout: "num_rep": { 2021-02-13T17:05:10.382 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "num_rep", 2021-02-13T17:05:10.382 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "int", 2021-02-13T17:05:10.382 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.382 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.382 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "3", 2021-02-13T17:05:10.382 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.382 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.382 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.382 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "default replica count for any created local pool", 2021-02-13T17:05:10.383 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.383 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.383 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.383 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.383 INFO:teuthology.orchestra.run.gibba037.stdout: "pg_num": { 2021-02-13T17:05:10.383 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "pg_num", 2021-02-13T17:05:10.383 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "int", 2021-02-13T17:05:10.383 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.383 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.383 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "128", 2021-02-13T17:05:10.383 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.383 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.383 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.383 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "default pg_num for any created local pool", 2021-02-13T17:05:10.384 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.384 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.384 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.384 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.384 INFO:teuthology.orchestra.run.gibba037.stdout: "prefix": { 2021-02-13T17:05:10.384 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "prefix", 2021-02-13T17:05:10.384 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.384 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.384 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.384 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.384 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.384 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.384 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.384 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "name prefix for any created local pool", 2021-02-13T17:05:10.385 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.385 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.385 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.385 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.385 INFO:teuthology.orchestra.run.gibba037.stdout: "subtree": { 2021-02-13T17:05:10.385 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "subtree", 2021-02-13T17:05:10.385 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.385 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.385 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.385 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "rack", 2021-02-13T17:05:10.385 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.385 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.385 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.385 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "CRUSH level for which to create a local pool", 2021-02-13T17:05:10.386 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.386 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.386 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.386 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.386 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.386 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.386 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.386 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "orchestrator_cli", 2021-02-13T17:05:10.386 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.386 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.386 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.386 INFO:teuthology.orchestra.run.gibba037.stdout: "orchestrator": { 2021-02-13T17:05:10.386 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "orchestrator", 2021-02-13T17:05:10.387 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.387 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.387 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.387 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.387 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.387 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.387 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.387 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.387 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.387 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.387 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.387 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.387 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.387 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.387 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.388 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "pg_autoscaler", 2021-02-13T17:05:10.388 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.388 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.388 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.388 INFO:teuthology.orchestra.run.gibba037.stdout: "sleep_interval": { 2021-02-13T17:05:10.388 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "sleep_interval", 2021-02-13T17:05:10.388 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.388 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.388 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.388 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "60", 2021-02-13T17:05:10.388 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.388 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.388 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.388 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.389 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.389 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.389 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.389 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.389 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.389 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.389 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.389 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "progress", 2021-02-13T17:05:10.389 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.389 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.389 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.389 INFO:teuthology.orchestra.run.gibba037.stdout: "enabled": { 2021-02-13T17:05:10.389 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "enabled", 2021-02-13T17:05:10.389 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.390 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.390 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.390 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "True", 2021-02-13T17:05:10.390 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.390 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.390 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.390 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.390 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.390 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.390 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.390 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.390 INFO:teuthology.orchestra.run.gibba037.stdout: "max_completed_events": { 2021-02-13T17:05:10.390 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "max_completed_events", 2021-02-13T17:05:10.391 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "int", 2021-02-13T17:05:10.391 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.391 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.391 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "50", 2021-02-13T17:05:10.391 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.391 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.391 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.391 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "number of past completed events to remember", 2021-02-13T17:05:10.391 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.391 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.391 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.391 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.391 INFO:teuthology.orchestra.run.gibba037.stdout: "persist_interval": { 2021-02-13T17:05:10.391 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "persist_interval", 2021-02-13T17:05:10.391 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "secs", 2021-02-13T17:05:10.392 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.392 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 1, 2021-02-13T17:05:10.392 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "5", 2021-02-13T17:05:10.392 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.392 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.392 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.392 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "how frequently to persist completed events", 2021-02-13T17:05:10.392 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.392 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.392 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.392 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.392 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.392 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.392 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.393 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "prometheus", 2021-02-13T17:05:10.393 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.393 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.393 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.393 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd_stats_pools": { 2021-02-13T17:05:10.393 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "rbd_stats_pools", 2021-02-13T17:05:10.393 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.393 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.393 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.393 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.393 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.393 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.393 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.393 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.394 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.394 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.394 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.394 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.394 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd_stats_pools_refresh_interval": { 2021-02-13T17:05:10.394 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "rbd_stats_pools_refresh_interval", 2021-02-13T17:05:10.394 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "int", 2021-02-13T17:05:10.394 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.394 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.394 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "300", 2021-02-13T17:05:10.394 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.394 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.394 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.395 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.395 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.395 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.395 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.395 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.395 INFO:teuthology.orchestra.run.gibba037.stdout: "scrape_interval": { 2021-02-13T17:05:10.395 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "scrape_interval", 2021-02-13T17:05:10.395 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.395 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.395 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.395 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.395 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.395 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.395 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.396 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.396 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.396 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.396 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.396 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.396 INFO:teuthology.orchestra.run.gibba037.stdout: "server_addr": { 2021-02-13T17:05:10.396 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "server_addr", 2021-02-13T17:05:10.396 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.396 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.396 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.396 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.396 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.396 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.396 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.397 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.397 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.397 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.397 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.397 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.397 INFO:teuthology.orchestra.run.gibba037.stdout: "server_port": { 2021-02-13T17:05:10.397 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "server_port", 2021-02-13T17:05:10.397 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.397 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.397 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.397 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.397 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.397 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.397 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.398 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.398 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.398 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.398 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.398 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.398 INFO:teuthology.orchestra.run.gibba037.stdout: "stale_cache_strategy": { 2021-02-13T17:05:10.398 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "stale_cache_strategy", 2021-02-13T17:05:10.398 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.398 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.398 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.398 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.398 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.398 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.398 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.399 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.399 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.399 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.399 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.399 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.399 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.399 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.399 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.399 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "rbd_support", 2021-02-13T17:05:10.399 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.399 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.399 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": {} 2021-02-13T17:05:10.399 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.400 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.400 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "restful", 2021-02-13T17:05:10.400 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.400 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.400 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.400 INFO:teuthology.orchestra.run.gibba037.stdout: "key_file": { 2021-02-13T17:05:10.400 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "key_file", 2021-02-13T17:05:10.400 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.400 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.400 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.400 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.400 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.400 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.400 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.401 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.401 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.401 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.401 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.401 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.401 INFO:teuthology.orchestra.run.gibba037.stdout: "server_addr": { 2021-02-13T17:05:10.401 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "server_addr", 2021-02-13T17:05:10.401 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.401 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.401 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.401 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.401 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.401 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.401 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.402 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.402 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.402 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.402 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.402 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.402 INFO:teuthology.orchestra.run.gibba037.stdout: "server_port": { 2021-02-13T17:05:10.402 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "server_port", 2021-02-13T17:05:10.402 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.402 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.402 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.402 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.402 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.402 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.402 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.403 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.403 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.403 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.403 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.403 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.403 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.403 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.403 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.403 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "rook", 2021-02-13T17:05:10.403 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.403 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.403 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": {} 2021-02-13T17:05:10.403 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.403 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.404 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "selftest", 2021-02-13T17:05:10.404 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.404 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.404 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.404 INFO:teuthology.orchestra.run.gibba037.stdout: "roption1": { 2021-02-13T17:05:10.404 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "roption1", 2021-02-13T17:05:10.404 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.404 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.404 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.404 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.404 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.404 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.404 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.404 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.405 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.405 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.405 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.405 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.405 INFO:teuthology.orchestra.run.gibba037.stdout: "roption2": { 2021-02-13T17:05:10.405 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "roption2", 2021-02-13T17:05:10.405 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.405 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.405 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.405 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "xyz", 2021-02-13T17:05:10.405 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.405 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.405 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.406 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.406 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.406 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.406 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.406 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.406 INFO:teuthology.orchestra.run.gibba037.stdout: "rwoption1": { 2021-02-13T17:05:10.406 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "rwoption1", 2021-02-13T17:05:10.406 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.406 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.406 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.407 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.407 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.407 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.407 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.407 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.407 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.407 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.407 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.407 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.407 INFO:teuthology.orchestra.run.gibba037.stdout: "rwoption2": { 2021-02-13T17:05:10.407 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "rwoption2", 2021-02-13T17:05:10.407 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "int", 2021-02-13T17:05:10.407 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.407 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.407 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.408 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.408 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.408 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.408 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.408 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.408 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.408 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.408 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.408 INFO:teuthology.orchestra.run.gibba037.stdout: "rwoption3": { 2021-02-13T17:05:10.408 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "rwoption3", 2021-02-13T17:05:10.408 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "float", 2021-02-13T17:05:10.408 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.408 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.409 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.409 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.409 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.409 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.409 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.409 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.409 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.409 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.409 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.409 INFO:teuthology.orchestra.run.gibba037.stdout: "rwoption4": { 2021-02-13T17:05:10.409 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "rwoption4", 2021-02-13T17:05:10.409 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.409 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.409 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.410 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.410 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.410 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.410 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.410 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.410 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.410 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.410 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.410 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.410 INFO:teuthology.orchestra.run.gibba037.stdout: "rwoption5": { 2021-02-13T17:05:10.410 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "rwoption5", 2021-02-13T17:05:10.410 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.410 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.410 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.411 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.411 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.411 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.411 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.411 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.411 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.411 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.411 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.411 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.411 INFO:teuthology.orchestra.run.gibba037.stdout: "rwoption6": { 2021-02-13T17:05:10.411 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "rwoption6", 2021-02-13T17:05:10.411 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.411 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.411 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.412 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "True", 2021-02-13T17:05:10.412 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.412 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.412 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.412 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.412 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.412 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.412 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.412 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.412 INFO:teuthology.orchestra.run.gibba037.stdout: "testkey": { 2021-02-13T17:05:10.412 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "testkey", 2021-02-13T17:05:10.412 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.412 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.412 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.413 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.413 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.413 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.413 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.413 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.413 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.413 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.413 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.413 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.413 INFO:teuthology.orchestra.run.gibba037.stdout: "testlkey": { 2021-02-13T17:05:10.413 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "testlkey", 2021-02-13T17:05:10.413 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.413 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.413 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.414 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.414 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.414 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.414 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.414 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.414 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.414 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.414 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.414 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.414 INFO:teuthology.orchestra.run.gibba037.stdout: "testnewline": { 2021-02-13T17:05:10.414 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "testnewline", 2021-02-13T17:05:10.414 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.414 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.414 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.415 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.415 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.415 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.415 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.415 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.415 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.415 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.415 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.415 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.415 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.415 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.415 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.415 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "ssh", 2021-02-13T17:05:10.415 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.416 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.416 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.416 INFO:teuthology.orchestra.run.gibba037.stdout: "inventory_cache_timeout_min": { 2021-02-13T17:05:10.416 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "inventory_cache_timeout_min", 2021-02-13T17:05:10.416 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.416 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.416 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.416 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.416 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.416 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.416 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.416 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.416 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.417 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.417 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.417 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.417 INFO:teuthology.orchestra.run.gibba037.stdout: "ssh_config_file": { 2021-02-13T17:05:10.417 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "ssh_config_file", 2021-02-13T17:05:10.417 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.417 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.417 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.417 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.417 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.417 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.417 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.417 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.417 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.418 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.418 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.418 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.418 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.418 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.418 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.418 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "status", 2021-02-13T17:05:10.418 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.418 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.418 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": {} 2021-02-13T17:05:10.418 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.418 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.418 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "telegraf", 2021-02-13T17:05:10.418 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.419 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.419 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.419 INFO:teuthology.orchestra.run.gibba037.stdout: "address": { 2021-02-13T17:05:10.419 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "address", 2021-02-13T17:05:10.419 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.419 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.419 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.419 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2021-02-13T17:05:10.419 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.419 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.419 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.419 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.419 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.419 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.420 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.420 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.420 INFO:teuthology.orchestra.run.gibba037.stdout: "interval": { 2021-02-13T17:05:10.420 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "interval", 2021-02-13T17:05:10.420 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "secs", 2021-02-13T17:05:10.420 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.420 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.420 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "15", 2021-02-13T17:05:10.420 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.420 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.420 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.420 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.420 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.420 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.421 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.421 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.421 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.421 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.421 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.421 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "telemetry", 2021-02-13T17:05:10.421 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.421 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.421 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.421 INFO:teuthology.orchestra.run.gibba037.stdout: "channel_basic": { 2021-02-13T17:05:10.421 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "channel_basic", 2021-02-13T17:05:10.421 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.421 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.421 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.422 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "True", 2021-02-13T17:05:10.422 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.422 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.422 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.422 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "Share basic cluster information (size, version)", 2021-02-13T17:05:10.422 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.422 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.422 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.422 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.422 INFO:teuthology.orchestra.run.gibba037.stdout: "channel_crash": { 2021-02-13T17:05:10.422 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "channel_crash", 2021-02-13T17:05:10.422 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.422 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.423 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.423 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "True", 2021-02-13T17:05:10.423 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.423 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.423 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.423 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.423 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.423 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.423 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.423 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.423 INFO:teuthology.orchestra.run.gibba037.stdout: "channel_device": { 2021-02-13T17:05:10.423 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "channel_device", 2021-02-13T17:05:10.423 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.423 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.424 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.424 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "True", 2021-02-13T17:05:10.424 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.424 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.424 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.424 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.424 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.424 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.424 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.424 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.424 INFO:teuthology.orchestra.run.gibba037.stdout: "channel_ident": { 2021-02-13T17:05:10.424 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "channel_ident", 2021-02-13T17:05:10.424 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.425 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.425 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.425 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "False", 2021-02-13T17:05:10.425 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.425 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.425 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.425 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.425 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.425 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.425 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.425 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.425 INFO:teuthology.orchestra.run.gibba037.stdout: "contact": { 2021-02-13T17:05:10.425 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "contact", 2021-02-13T17:05:10.425 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.426 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.426 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.426 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "None", 2021-02-13T17:05:10.426 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.426 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.426 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.426 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.426 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.426 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.426 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.426 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.426 INFO:teuthology.orchestra.run.gibba037.stdout: "description": { 2021-02-13T17:05:10.426 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "description", 2021-02-13T17:05:10.426 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.427 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.427 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.427 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "None", 2021-02-13T17:05:10.427 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.427 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.427 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.427 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.427 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.427 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.427 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.427 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.427 INFO:teuthology.orchestra.run.gibba037.stdout: "device_url": { 2021-02-13T17:05:10.427 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "device_url", 2021-02-13T17:05:10.427 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.428 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.428 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.428 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "https://telemetry.ceph.com/device", 2021-02-13T17:05:10.428 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.428 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.428 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.428 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.428 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.428 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.428 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.428 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.428 INFO:teuthology.orchestra.run.gibba037.stdout: "enabled": { 2021-02-13T17:05:10.428 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "enabled", 2021-02-13T17:05:10.428 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.429 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.429 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.429 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "False", 2021-02-13T17:05:10.429 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.429 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.429 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.429 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.429 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.429 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.429 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.429 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.429 INFO:teuthology.orchestra.run.gibba037.stdout: "interval": { 2021-02-13T17:05:10.429 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "interval", 2021-02-13T17:05:10.429 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "int", 2021-02-13T17:05:10.430 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.430 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.430 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "24", 2021-02-13T17:05:10.430 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "8", 2021-02-13T17:05:10.430 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.430 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.430 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.430 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.430 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.430 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.430 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.430 INFO:teuthology.orchestra.run.gibba037.stdout: "last_opt_revision": { 2021-02-13T17:05:10.430 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "last_opt_revision", 2021-02-13T17:05:10.430 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "int", 2021-02-13T17:05:10.431 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.431 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.431 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "1", 2021-02-13T17:05:10.431 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.431 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.431 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.431 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.431 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.431 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.431 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.431 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.431 INFO:teuthology.orchestra.run.gibba037.stdout: "leaderboard": { 2021-02-13T17:05:10.431 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "leaderboard", 2021-02-13T17:05:10.431 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "bool", 2021-02-13T17:05:10.432 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.432 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.432 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "False", 2021-02-13T17:05:10.432 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.432 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.432 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.432 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.432 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.432 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.432 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.432 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.432 INFO:teuthology.orchestra.run.gibba037.stdout: "organization": { 2021-02-13T17:05:10.432 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "organization", 2021-02-13T17:05:10.432 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.433 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.433 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.433 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "None", 2021-02-13T17:05:10.433 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.433 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.433 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.433 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.433 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.433 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.433 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.433 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.433 INFO:teuthology.orchestra.run.gibba037.stdout: "proxy": { 2021-02-13T17:05:10.433 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "proxy", 2021-02-13T17:05:10.434 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.434 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.434 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.434 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "None", 2021-02-13T17:05:10.434 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.434 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.434 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.434 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.434 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.434 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.434 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.434 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.434 INFO:teuthology.orchestra.run.gibba037.stdout: "url": { 2021-02-13T17:05:10.434 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "url", 2021-02-13T17:05:10.435 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.435 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.435 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.435 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "https://telemetry.ceph.com/report", 2021-02-13T17:05:10.435 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.435 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.435 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.435 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.435 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.435 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.435 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.435 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.435 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.435 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.436 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.436 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "test_orchestrator", 2021-02-13T17:05:10.436 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.436 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.436 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": {} 2021-02-13T17:05:10.436 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.436 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.436 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "volumes", 2021-02-13T17:05:10.436 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.436 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.436 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.436 INFO:teuthology.orchestra.run.gibba037.stdout: "max_concurrent_clones": { 2021-02-13T17:05:10.436 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "max_concurrent_clones", 2021-02-13T17:05:10.436 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "int", 2021-02-13T17:05:10.437 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.437 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.437 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "4", 2021-02-13T17:05:10.437 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.437 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.437 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.437 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "Number of asynchronous cloner threads", 2021-02-13T17:05:10.437 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.437 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.437 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.437 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.437 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.437 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.438 INFO:teuthology.orchestra.run.gibba037.stdout: { 2021-02-13T17:05:10.438 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "zabbix", 2021-02-13T17:05:10.438 INFO:teuthology.orchestra.run.gibba037.stdout: "can_run": true, 2021-02-13T17:05:10.438 INFO:teuthology.orchestra.run.gibba037.stdout: "error_string": "", 2021-02-13T17:05:10.438 INFO:teuthology.orchestra.run.gibba037.stdout: "module_options": { 2021-02-13T17:05:10.438 INFO:teuthology.orchestra.run.gibba037.stdout: "identifier": { 2021-02-13T17:05:10.438 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "identifier", 2021-02-13T17:05:10.438 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.438 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.438 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.438 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "", 2021-02-13T17:05:10.438 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.438 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.438 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.439 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.439 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.439 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.439 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.439 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.439 INFO:teuthology.orchestra.run.gibba037.stdout: "interval": { 2021-02-13T17:05:10.439 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "interval", 2021-02-13T17:05:10.439 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "secs", 2021-02-13T17:05:10.439 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.439 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.439 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "60", 2021-02-13T17:05:10.439 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.439 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.439 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.440 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.440 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.440 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.440 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.440 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.440 INFO:teuthology.orchestra.run.gibba037.stdout: "zabbix_host": { 2021-02-13T17:05:10.440 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "zabbix_host", 2021-02-13T17:05:10.440 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.440 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.440 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.440 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "None", 2021-02-13T17:05:10.440 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.440 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.440 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.441 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.441 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.441 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.441 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.441 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.441 INFO:teuthology.orchestra.run.gibba037.stdout: "zabbix_port": { 2021-02-13T17:05:10.441 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "zabbix_port", 2021-02-13T17:05:10.441 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "int", 2021-02-13T17:05:10.441 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.441 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.441 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "10051", 2021-02-13T17:05:10.441 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.441 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.441 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.442 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.442 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.442 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.442 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.442 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.442 INFO:teuthology.orchestra.run.gibba037.stdout: "zabbix_sender": { 2021-02-13T17:05:10.442 INFO:teuthology.orchestra.run.gibba037.stdout: "name": "zabbix_sender", 2021-02-13T17:05:10.442 INFO:teuthology.orchestra.run.gibba037.stdout: "type": "str", 2021-02-13T17:05:10.442 INFO:teuthology.orchestra.run.gibba037.stdout: "level": "advanced", 2021-02-13T17:05:10.442 INFO:teuthology.orchestra.run.gibba037.stdout: "flags": 0, 2021-02-13T17:05:10.442 INFO:teuthology.orchestra.run.gibba037.stdout: "default_value": "/usr/bin/zabbix_sender", 2021-02-13T17:05:10.442 INFO:teuthology.orchestra.run.gibba037.stdout: "min": "", 2021-02-13T17:05:10.442 INFO:teuthology.orchestra.run.gibba037.stdout: "max": "", 2021-02-13T17:05:10.442 INFO:teuthology.orchestra.run.gibba037.stdout: "enum_allowed": [], 2021-02-13T17:05:10.443 INFO:teuthology.orchestra.run.gibba037.stdout: "desc": "", 2021-02-13T17:05:10.443 INFO:teuthology.orchestra.run.gibba037.stdout: "long_desc": "", 2021-02-13T17:05:10.443 INFO:teuthology.orchestra.run.gibba037.stdout: "tags": [], 2021-02-13T17:05:10.443 INFO:teuthology.orchestra.run.gibba037.stdout: "see_also": [] 2021-02-13T17:05:10.443 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.443 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.443 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.443 INFO:teuthology.orchestra.run.gibba037.stdout: ], 2021-02-13T17:05:10.443 INFO:teuthology.orchestra.run.gibba037.stdout: "services": {}, 2021-02-13T17:05:10.443 INFO:teuthology.orchestra.run.gibba037.stdout: "always_on_modules": { 2021-02-13T17:05:10.443 INFO:teuthology.orchestra.run.gibba037.stdout: "nautilus": [ 2021-02-13T17:05:10.443 INFO:teuthology.orchestra.run.gibba037.stdout: "balancer", 2021-02-13T17:05:10.443 INFO:teuthology.orchestra.run.gibba037.stdout: "crash", 2021-02-13T17:05:10.443 INFO:teuthology.orchestra.run.gibba037.stdout: "devicehealth", 2021-02-13T17:05:10.444 INFO:teuthology.orchestra.run.gibba037.stdout: "orchestrator_cli", 2021-02-13T17:05:10.444 INFO:teuthology.orchestra.run.gibba037.stdout: "progress", 2021-02-13T17:05:10.444 INFO:teuthology.orchestra.run.gibba037.stdout: "rbd_support", 2021-02-13T17:05:10.444 INFO:teuthology.orchestra.run.gibba037.stdout: "status", 2021-02-13T17:05:10.444 INFO:teuthology.orchestra.run.gibba037.stdout: "volumes" 2021-02-13T17:05:10.444 INFO:teuthology.orchestra.run.gibba037.stdout: ] 2021-02-13T17:05:10.444 INFO:teuthology.orchestra.run.gibba037.stdout: } 2021-02-13T17:05:10.444 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.444 INFO:teuthology.orchestra.run.gibba037.stdout: "servicemap": { 2021-02-13T17:05:10.444 INFO:teuthology.orchestra.run.gibba037.stdout: "epoch": 1, 2021-02-13T17:05:10.444 INFO:teuthology.orchestra.run.gibba037.stdout: "modified": "0.000000", 2021-02-13T17:05:10.444 INFO:teuthology.orchestra.run.gibba037.stdout: "services": {} 2021-02-13T17:05:10.444 INFO:teuthology.orchestra.run.gibba037.stdout: }, 2021-02-13T17:05:10.444 INFO:teuthology.orchestra.run.gibba037.stdout: "progress_events": {} 2021-02-13T17:05:10.445 INFO:teuthology.orchestra.run.gibba037.stdout:} 2021-02-13T17:05:10.446 INFO:tasks.ceph.ceph_manager.c1:{'fsid': '611a710d-9f14-45ea-aab7-0ffef279fb6a', 'health': {'checks': {}, 'status': 'HEALTH_OK'}, 'election_epoch': 3, 'quorum': [0], 'quorum_names': ['a'], 'quorum_age': 13, 'monmap': {'epoch': 1, 'min_mon_release_name': '14', 'num_mons': 1}, 'osdmap': {'osdmap': {'epoch': 11, 'num_osds': 3, 'num_up_osds': 3, 'num_in_osds': 3, 'num_remapped_pgs': 0}}, 'pgmap': {'pgs_by_state': [{'state_name': 'active+clean', 'count': 8}], 'num_pgs': 8, 'num_pools': 1, 'num_objects': 0, 'data_bytes': 0, 'bytes_used': 3221528576, 'bytes_avail': 318901018624, 'bytes_total': 322122547200}, 'fsmap': {'epoch': 1, 'by_rank': [], 'up:standby': 0}, 'mgrmap': {'epoch': 3, 'active_gid': 4101, 'active_name': 'x', 'active_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.137:6824', 'nonce': 14041}, {'type': 'v1', 'addr': '172.21.2.137:6825', 'nonce': 14041}]}, 'active_addr': '172.21.2.137:6825/14041', 'active_change': '2021-02-13 17:04:58.576756', 'available': True, 'standbys': [], 'modules': ['iostat', 'restful'], 'available_modules': [{'name': 'alerts', 'can_run': True, 'error_string': '', 'module_options': {'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'How frequently to reexamine health status', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_destination': {'name': 'smtp_destination', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email address to send alerts to', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_from_name': {'name': 'smtp_from_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'Ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email From: name', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_host': {'name': 'smtp_host', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_password': {'name': 'smtp_password', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Password to authenticate with', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_port': {'name': 'smtp_port', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '465', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP port', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_sender': {'name': 'smtp_sender', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP envelope sender', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_ssl': {'name': 'smtp_ssl', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Use SSL to connect to SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_user': {'name': 'smtp_user', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'User to authenticate as', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ansible', 'can_run': True, 'error_string': '', 'module_options': {'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_url': {'name': 'server_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_server': {'name': 'verify_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'balancer', 'can_run': True, 'error_string': '', 'module_options': {'active': {'name': 'active', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically balance PGs across cluster', 'long_desc': '', 'tags': [], 'see_also': []}, 'begin_time': {'name': 'begin_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '0000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'beginning time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'begin_weekday': {'name': 'begin_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to this day of the week or later', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'crush_compat_max_iterations': {'name': 'crush_compat_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '25', 'min': '1', 'max': '250', 'enum_allowed': [], 'desc': 'maximum number of iterations to attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'crush_compat_metrics': {'name': 'crush_compat_metrics', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'pgs,objects,bytes', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'metrics with which to calculate OSD utilization', 'long_desc': 'Value is a list of one or more of "pgs", "objects", or "bytes", and indicates which metrics to use to balance utilization.', 'tags': [], 'see_also': []}, 'crush_compat_step': {'name': 'crush_compat_step', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0.5', 'min': '0.001', 'max': '0.999', 'enum_allowed': [], 'desc': 'aggressiveness of optimization', 'long_desc': '.99 is very aggressive, .01 is less aggressive', 'tags': [], 'see_also': []}, 'end_time': {'name': 'end_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '2400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'ending time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'end_weekday': {'name': 'end_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '7', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to days of the week earlier than this', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'min_score': {'name': 'min_score', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'minimum score, below which no optimization is attempted', 'long_desc': '', 'tags': [], 'see_also': []}, 'mode': {'name': 'mode', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'none', 'min': '', 'max': '', 'enum_allowed': ['crush-compat', 'none', 'upmap'], 'desc': 'Balancer mode', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_ids': {'name': 'pool_ids', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'pools which the automatic balancing will be limited to', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'upmap_max_deviation': {'name': 'upmap_max_deviation', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '1', 'max': '', 'enum_allowed': [], 'desc': 'deviation below which no optimization is attempted', 'long_desc': 'If the number of PGs are within this count then no optimization is attempted', 'tags': [], 'see_also': []}, 'upmap_max_iterations': {'name': 'upmap_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '10', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'maximum upmap optimization iterations', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'crash', 'can_run': True, 'error_string': '', 'module_options': {'retain_interval': {'name': 'retain_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '31536000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain crashes before pruning them', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_recent_interval': {'name': 'warn_recent_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '1209600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'time interval in which to warn about recent crashes', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'dashboard', 'can_run': True, 'error_string': '', 'module_options': {'ALERTMANAGER_API_HOST': {'name': 'ALERTMANAGER_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_ENABLED': {'name': 'AUDIT_API_ENABLED', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_LOG_PAYLOAD': {'name': 'AUDIT_API_LOG_PAYLOAD', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ENABLE_BROWSABLE_API': {'name': 'ENABLE_BROWSABLE_API', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_cephfs': {'name': 'FEATURE_TOGGLE_cephfs', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_iscsi': {'name': 'FEATURE_TOGGLE_iscsi', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_mirroring': {'name': 'FEATURE_TOGGLE_mirroring', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rbd': {'name': 'FEATURE_TOGGLE_rbd', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rgw': {'name': 'FEATURE_TOGGLE_rgw', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE': {'name': 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_PASSWORD': {'name': 'GRAFANA_API_PASSWORD', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_SSL_VERIFY': {'name': 'GRAFANA_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_URL': {'name': 'GRAFANA_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_USERNAME': {'name': 'GRAFANA_API_USERNAME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_FRONTEND_API_URL': {'name': 'GRAFANA_FRONTEND_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_UPDATE_DASHBOARDS': {'name': 'GRAFANA_UPDATE_DASHBOARDS', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ISCSI_API_SSL_VERIFICATION': {'name': 'ISCSI_API_SSL_VERIFICATION', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'PROMETHEUS_API_HOST': {'name': 'PROMETHEUS_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'REST_REQUESTS_TIMEOUT': {'name': 'REST_REQUESTS_TIMEOUT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '45', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ACCESS_KEY': {'name': 'RGW_API_ACCESS_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ADMIN_RESOURCE': {'name': 'RGW_API_ADMIN_RESOURCE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_HOST': {'name': 'RGW_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_PORT': {'name': 'RGW_API_PORT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '80', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SCHEME': {'name': 'RGW_API_SCHEME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'http', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SECRET_KEY': {'name': 'RGW_API_SECRET_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SSL_VERIFY': {'name': 'RGW_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_USER_ID': {'name': 'RGW_API_USER_ID', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'crt_file': {'name': 'crt_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'debug': {'name': 'debug', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Enable/disable debug options', 'long_desc': '', 'tags': [], 'see_also': []}, 'jwt_token_ttl': {'name': 'jwt_token_ttl', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '28800', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '::', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8080', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl_server_port': {'name': 'ssl_server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8443', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_behaviour': {'name': 'standby_behaviour', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'redirect', 'min': '', 'max': '', 'enum_allowed': ['error', 'redirect'], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_error_status_code': {'name': 'standby_error_status_code', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '500', 'min': '400', 'max': '599', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url_prefix': {'name': 'url_prefix', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'deepsea', 'can_run': True, 'error_string': '', 'module_options': {'salt_api_eauth': {'name': 'salt_api_eauth', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'sharedsecret', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_password': {'name': 'salt_api_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_url': {'name': 'salt_api_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_username': {'name': 'salt_api_username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'devicehealth', 'can_run': True, 'error_string': '', 'module_options': {'enable_monitoring': {'name': 'enable_monitoring', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'monitor device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'mark_out_threshold': {'name': 'mark_out_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '2419200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically mark OSD if it may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_name': {'name': 'pool_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'device_health_metrics', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name of pool in which to store device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'retention_period': {'name': 'retention_period', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '15552000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_frequency': {'name': 'scrape_frequency', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to scrape device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'self_heal': {'name': 'self_heal', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'preemptively heal cluster around devices that may fail', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and check device health', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_threshold': {'name': 'warn_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '7257600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'raise health warning if OSD may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_cloud', 'can_run': True, 'error_string': '', 'module_options': {'diskprediction_cert_context': {'name': 'diskprediction_cert_context', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_default_authority': {'name': 'diskprediction_default_authority', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_password': {'name': 'diskprediction_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_port': {'name': 'diskprediction_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '31400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_retrieve_prediction_interval': {'name': 'diskprediction_retrieve_prediction_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_server': {'name': 'diskprediction_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_ssl_target_name_override': {'name': 'diskprediction_ssl_target_name_override', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_metrics_interval': {'name': 'diskprediction_upload_metrics_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_smart_interval': {'name': 'diskprediction_upload_smart_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_user': {'name': 'diskprediction_user', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_local', 'can_run': True, 'error_string': '', 'module_options': {'predict_interval': {'name': 'predict_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'influx', 'can_run': False, 'error_string': 'influxdb python module not found', 'module_options': {'batch_size': {'name': 'batch_size', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'database': {'name': 'database', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'hostname': {'name': 'hostname', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '30', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'port': {'name': 'port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '8086', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'false', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'threads': {'name': 'threads', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_ssl': {'name': 'verify_ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'true', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'insights', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'iostat', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'localpool', 'can_run': True, 'error_string': '', 'module_options': {'failure_domain': {'name': 'failure_domain', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'host', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'failure domain for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'min_size': {'name': 'min_size', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default min_size for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'num_rep': {'name': 'num_rep', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '3', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default replica count for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'pg_num': {'name': 'pg_num', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '128', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default pg_num for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'prefix': {'name': 'prefix', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name prefix for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'subtree': {'name': 'subtree', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'rack', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'CRUSH level for which to create a local pool', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'orchestrator_cli', 'can_run': True, 'error_string': '', 'module_options': {'orchestrator': {'name': 'orchestrator', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'pg_autoscaler', 'can_run': True, 'error_string': '', 'module_options': {'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'progress', 'can_run': True, 'error_string': '', 'module_options': {'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'max_completed_events': {'name': 'max_completed_events', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '50', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'number of past completed events to remember', 'long_desc': '', 'tags': [], 'see_also': []}, 'persist_interval': {'name': 'persist_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to persist completed events', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'prometheus', 'can_run': True, 'error_string': '', 'module_options': {'rbd_stats_pools': {'name': 'rbd_stats_pools', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rbd_stats_pools_refresh_interval': {'name': 'rbd_stats_pools_refresh_interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '300', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_interval': {'name': 'scrape_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'stale_cache_strategy': {'name': 'stale_cache_strategy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rbd_support', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'restful', 'can_run': True, 'error_string': '', 'module_options': {'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rook', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'selftest', 'can_run': True, 'error_string': '', 'module_options': {'roption1': {'name': 'roption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'roption2': {'name': 'roption2', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'xyz', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption1': {'name': 'rwoption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption2': {'name': 'rwoption2', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption3': {'name': 'rwoption3', 'type': 'float', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption4': {'name': 'rwoption4', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption5': {'name': 'rwoption5', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption6': {'name': 'rwoption6', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testkey': {'name': 'testkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testlkey': {'name': 'testlkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testnewline': {'name': 'testnewline', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ssh', 'can_run': True, 'error_string': '', 'module_options': {'inventory_cache_timeout_min': {'name': 'inventory_cache_timeout_min', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssh_config_file': {'name': 'ssh_config_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'status', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'telegraf', 'can_run': True, 'error_string': '', 'module_options': {'address': {'name': 'address', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'unixgram:///tmp/telegraf.sock', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '15', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'telemetry', 'can_run': True, 'error_string': '', 'module_options': {'channel_basic': {'name': 'channel_basic', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Share basic cluster information (size, version)', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_crash': {'name': 'channel_crash', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_device': {'name': 'channel_device', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_ident': {'name': 'channel_ident', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'contact': {'name': 'contact', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'description': {'name': 'description', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'device_url': {'name': 'device_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/device', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '24', 'min': '8', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'last_opt_revision': {'name': 'last_opt_revision', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '1', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'leaderboard': {'name': 'leaderboard', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'organization': {'name': 'organization', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'proxy': {'name': 'proxy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url': {'name': 'url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/report', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'test_orchestrator', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'volumes', 'can_run': True, 'error_string': '', 'module_options': {'max_concurrent_clones': {'name': 'max_concurrent_clones', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '4', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Number of asynchronous cloner threads', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'zabbix', 'can_run': True, 'error_string': '', 'module_options': {'identifier': {'name': 'identifier', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_host': {'name': 'zabbix_host', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_port': {'name': 'zabbix_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '10051', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_sender': {'name': 'zabbix_sender', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '/usr/bin/zabbix_sender', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}], 'services': {}, 'always_on_modules': {'nautilus': ['balancer', 'crash', 'devicehealth', 'orchestrator_cli', 'progress', 'rbd_support', 'status', 'volumes']}}, 'servicemap': {'epoch': 1, 'modified': '0.000000', 'services': {}}, 'progress_events': {}} 2021-02-13T17:05:10.447 INFO:tasks.ceph.ceph_manager.c1:clean! 2021-02-13T17:05:10.447 INFO:tasks.ceph:Waiting until ceph cluster c1 is healthy... 2021-02-13T17:05:10.448 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 health 2021-02-13T17:05:10.607 INFO:teuthology.misc.health.gibba037.stdout:HEALTH_OK 2021-02-13T17:05:10.615 DEBUG:teuthology.misc:Ceph health: HEALTH_OK 2021-02-13T17:05:10.615 INFO:teuthology.run_tasks:Running task ceph... 2021-02-13T17:05:10.632 INFO:tasks.ceph:Creating ceph cluster c2... 2021-02-13T17:05:10.632 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'c2', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-02-13T17:05:10.632 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877897', 'branch': 'wip-yuri3-testing-2021-02-12-0757-nautilus', 'description': 'rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '5877897', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'gibba', 'name': 'yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba', 'nuke-on-error': True, 'os_type': 'ubuntu', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2021-02-12-0757-nautilus'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1', 'wait-for-scrub': False}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1'}}, 'rgw': {'compression type': 'random', 'frontend': 'beast'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}, {'endpoints': ['c1.client.1'], 'name': 'test-zone3'}, {'endpoints': ['c2.client.1'], 'is_pubsub': True, 'name': 'test-zone4'}]}]}, 'workunit': {'branch': 'wip-yuri3-testing-2021-02-12-0757-nautilus', 'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'], ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']], 'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-yuri3-testing-2021-02-12-0757-nautilus', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1', 'targets': {'gibba037.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzABDCsGE9yRhAkC6g75qKS7gUEu8hpPCM5R4uj5uToKOrjI8K+TxzOqQwnmxD84g3IltOBDEnv8a06qFbeI0GYvItL3MELTesE9s8aVAgkhmzSn7wYdnRH8EY+sIRY2RHWDzrK8OxKN0d1XR1fjPsoh2fbZ2saFRLt12+//zy6AsVghxQxC1d0CAeCqUQvHgKwMQaR+3fTuszGC6SUqbgwUvtB2tz8c4o5B+GbBd8FIS/IbEGIdYd4GhPRVrNLz8fAGO5ghtdgP41/RFxNxRsLqojliWWAu+tVbS12Ba+/wUPjdo0iRk+l87KEhFgP8+MMX0zcc4S5pwrzy1iaplL', 'gibba038.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDD7VwUSrYdHXOl4pmIZcvEij6kXTpMa6hWNCa/64cQ49FwHErn3O5fxtxDVgAv9Bj+bFPArBTvEu/YPwrNeMK+siR3jG85n4JW0Xi5loAw1FgI8jV246kTf6qjxIfd3kRbVfSzMm6EY2LZAJlwe66czjKkYWoVVKUSS5S3IUPlxWCzZDP9hNpbVN9IgI6NQ/E/C8EHVp69+e+k+TYC5Wh64OutsMswwGml3X8tFu+M8NIJYePKC7k5OTix4+GQWiiY89ckU7mjpLVLC3kwPciVPf5wDck04ZJwwmpZwi+Mqp4d81o8RhbVjbVFpmGDdIZHOLa2fRQfm3hSSjgFJrVh'}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1', 'wait-for-scrub': False}}, {'ceph': {'cluster': 'c2', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1', 'wait-for-scrub': False}}, {'rgw': {'c1.client.0': {'port': 8000}, 'c1.client.1': {'port': 8001}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 60}}}], 'teuthology_branch': 'master', 'teuthology_sha1': '87d40f79d7da6caf6da06c190938773bf745140c', 'timestamp': '2021-02-12_17:45:41', 'tube': 'gibba', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.gibba.29737'} 2021-02-13T17:05:10.633 DEBUG:teuthology.orchestra.run.gibba037:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2021-02-13T17:05:10.636 DEBUG:teuthology.orchestra.run.gibba038:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2021-02-13T17:05:10.646 DEBUG:teuthology.orchestra.run.gibba037:> sudo install -d -m0777 -- /var/run/ceph 2021-02-13T17:05:10.684 DEBUG:teuthology.orchestra.run.gibba038:> sudo install -d -m0777 -- /var/run/ceph 2021-02-13T17:05:10.696 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-02-13T17:05:10.697 DEBUG:teuthology.orchestra.run.gibba038:> dd if=/scratch_devs of=/dev/stdout 2021-02-13T17:05:10.748 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-02-13T17:05:10.749 DEBUG:teuthology.orchestra.run.gibba038:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-02-13T17:05:10.796 INFO:teuthology.orchestra.run.gibba038.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-02-13T17:05:10.796 INFO:teuthology.orchestra.run.gibba038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-13T17:05:10.796 INFO:teuthology.orchestra.run.gibba038.stdout:Device: 6h/6d Inode: 333 Links: 1 2021-02-13T17:05:10.796 INFO:teuthology.orchestra.run.gibba038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-13T17:05:10.797 INFO:teuthology.orchestra.run.gibba038.stdout:Access: 2021-02-13 17:02:34.741285996 +0000 2021-02-13T17:05:10.797 INFO:teuthology.orchestra.run.gibba038.stdout:Modify: 2021-02-13 17:02:34.673251997 +0000 2021-02-13T17:05:10.797 INFO:teuthology.orchestra.run.gibba038.stdout:Change: 2021-02-13 17:02:34.673251997 +0000 2021-02-13T17:05:10.797 INFO:teuthology.orchestra.run.gibba038.stdout: Birth: - 2021-02-13T17:05:10.800 INFO:teuthology.orchestra.run.gibba038.stderr:1+0 records in 2021-02-13T17:05:10.800 INFO:teuthology.orchestra.run.gibba038.stderr:1+0 records out 2021-02-13T17:05:10.800 INFO:teuthology.orchestra.run.gibba038.stderr:512 bytes copied, 0.000205326 s, 2.5 MB/s 2021-02-13T17:05:10.802 DEBUG:teuthology.orchestra.run.gibba038:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-02-13T17:05:10.853 INFO:teuthology.orchestra.run.gibba038.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-02-13T17:05:10.853 INFO:teuthology.orchestra.run.gibba038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-13T17:05:10.854 INFO:teuthology.orchestra.run.gibba038.stdout:Device: 6h/6d Inode: 339 Links: 1 2021-02-13T17:05:10.854 INFO:teuthology.orchestra.run.gibba038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-13T17:05:10.854 INFO:teuthology.orchestra.run.gibba038.stdout:Access: 2021-02-13 17:02:34.985407991 +0000 2021-02-13T17:05:10.854 INFO:teuthology.orchestra.run.gibba038.stdout:Modify: 2021-02-13 17:02:34.865347993 +0000 2021-02-13T17:05:10.854 INFO:teuthology.orchestra.run.gibba038.stdout:Change: 2021-02-13 17:02:34.865347993 +0000 2021-02-13T17:05:10.855 INFO:teuthology.orchestra.run.gibba038.stdout: Birth: - 2021-02-13T17:05:10.860 INFO:teuthology.orchestra.run.gibba038.stderr:1+0 records in 2021-02-13T17:05:10.861 INFO:teuthology.orchestra.run.gibba038.stderr:1+0 records out 2021-02-13T17:05:10.861 INFO:teuthology.orchestra.run.gibba038.stderr:512 bytes copied, 0.000188805 s, 2.7 MB/s 2021-02-13T17:05:10.863 DEBUG:teuthology.orchestra.run.gibba038:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-02-13T17:05:10.908 INFO:teuthology.orchestra.run.gibba038.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-02-13T17:05:10.909 INFO:teuthology.orchestra.run.gibba038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-13T17:05:10.909 INFO:teuthology.orchestra.run.gibba038.stdout:Device: 6h/6d Inode: 345 Links: 1 2021-02-13T17:05:10.909 INFO:teuthology.orchestra.run.gibba038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-13T17:05:10.909 INFO:teuthology.orchestra.run.gibba038.stdout:Access: 2021-02-13 17:02:35.153491988 +0000 2021-02-13T17:05:10.909 INFO:teuthology.orchestra.run.gibba038.stdout:Modify: 2021-02-13 17:02:35.113471988 +0000 2021-02-13T17:05:10.910 INFO:teuthology.orchestra.run.gibba038.stdout:Change: 2021-02-13 17:02:35.113471988 +0000 2021-02-13T17:05:10.910 INFO:teuthology.orchestra.run.gibba038.stdout: Birth: - 2021-02-13T17:05:10.913 INFO:teuthology.orchestra.run.gibba038.stderr:1+0 records in 2021-02-13T17:05:10.913 INFO:teuthology.orchestra.run.gibba038.stderr:1+0 records out 2021-02-13T17:05:10.913 INFO:teuthology.orchestra.run.gibba038.stderr:512 bytes copied, 0.000225885 s, 2.3 MB/s 2021-02-13T17:05:10.916 DEBUG:teuthology.orchestra.run.gibba038:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-02-13T17:05:10.966 INFO:teuthology.orchestra.run.gibba038.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-02-13T17:05:10.966 INFO:teuthology.orchestra.run.gibba038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-13T17:05:10.966 INFO:teuthology.orchestra.run.gibba038.stdout:Device: 6h/6d Inode: 351 Links: 1 2021-02-13T17:05:10.966 INFO:teuthology.orchestra.run.gibba038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-13T17:05:10.966 INFO:teuthology.orchestra.run.gibba038.stdout:Access: 2021-02-13 17:02:35.313571984 +0000 2021-02-13T17:05:10.967 INFO:teuthology.orchestra.run.gibba038.stdout:Modify: 2021-02-13 17:02:35.249539986 +0000 2021-02-13T17:05:10.967 INFO:teuthology.orchestra.run.gibba038.stdout:Change: 2021-02-13 17:02:35.249539986 +0000 2021-02-13T17:05:10.967 INFO:teuthology.orchestra.run.gibba038.stdout: Birth: - 2021-02-13T17:05:10.973 INFO:teuthology.orchestra.run.gibba038.stderr:1+0 records in 2021-02-13T17:05:10.973 INFO:teuthology.orchestra.run.gibba038.stderr:1+0 records out 2021-02-13T17:05:10.974 INFO:teuthology.orchestra.run.gibba038.stderr:512 bytes copied, 0.000216388 s, 2.4 MB/s 2021-02-13T17:05:10.975 INFO:tasks.ceph:osd dev map: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-02-13T17:05:10.976 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@gibba038.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}} 2021-02-13T17:05:10.976 INFO:tasks.ceph:Generating config... 2021-02-13T17:05:10.977 INFO:tasks.ceph:[client] debug rgw = 20 2021-02-13T17:05:10.977 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2021-02-13T17:05:10.977 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-02-13T17:05:10.977 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2021-02-13T17:05:10.977 INFO:tasks.ceph:[client] rgw data log num shards = 4 2021-02-13T17:05:10.977 INFO:tasks.ceph:[client] rgw md log max shards = 4 2021-02-13T17:05:10.977 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2021-02-13T17:05:10.978 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2021-02-13T17:05:10.978 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2021-02-13T17:05:10.978 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-02-13T17:05:10.978 INFO:tasks.ceph:[mgr] debug ms = 1 2021-02-13T17:05:10.978 INFO:tasks.ceph:[mon] debug mon = 20 2021-02-13T17:05:10.978 INFO:tasks.ceph:[mon] debug ms = 1 2021-02-13T17:05:10.978 INFO:tasks.ceph:[mon] debug paxos = 20 2021-02-13T17:05:10.978 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2021-02-13T17:05:10.978 INFO:tasks.ceph:[osd] debug filestore = 20 2021-02-13T17:05:10.978 INFO:tasks.ceph:[osd] debug journal = 20 2021-02-13T17:05:10.978 INFO:tasks.ceph:[osd] debug ms = 20 2021-02-13T17:05:10.978 INFO:tasks.ceph:[osd] debug osd = 25 2021-02-13T17:05:10.979 INFO:tasks.ceph:[osd] osd fast shutdown = False 2021-02-13T17:05:10.979 INFO:tasks.ceph:[osd.0] osd_max_omap_entries_per_request = 10 2021-02-13T17:05:10.979 INFO:tasks.ceph:[osd.1] osd_max_omap_entries_per_request = 1000 2021-02-13T17:05:10.979 INFO:tasks.ceph:[osd.2] osd_max_omap_entries_per_request = 10000 2021-02-13T17:05:10.979 INFO:tasks.ceph:Setting up c2.mon.a... 2021-02-13T17:05:10.979 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c2.keyring 2021-02-13T17:05:11.058 INFO:teuthology.orchestra.run.gibba038.stdout:creating /etc/ceph/c2.keyring 2021-02-13T17:05:11.060 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c2.keyring 2021-02-13T17:05:11.152 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-02-13T17:05:11.162 DEBUG:tasks.ceph:Ceph mon addresses: [('c2.mon.a', '172.21.2.138')] 2021-02-13T17:05:11.163 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.2.138 --print /home/ubuntu/cephtest/c2.monmap 2021-02-13T17:05:11.247 INFO:teuthology.orchestra.run.gibba038.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c2.monmap 2021-02-13T17:05:11.247 INFO:teuthology.orchestra.run.gibba038.stdout:monmaptool: generated fsid 9862e2e1-3629-4a37-b410-fe5ad22a1229 2021-02-13T17:05:11.247 INFO:teuthology.orchestra.run.gibba038.stdout:epoch 0 2021-02-13T17:05:11.247 INFO:teuthology.orchestra.run.gibba038.stdout:fsid 9862e2e1-3629-4a37-b410-fe5ad22a1229 2021-02-13T17:05:11.247 INFO:teuthology.orchestra.run.gibba038.stdout:last_changed 2021-02-13 17:05:11.245270 2021-02-13T17:05:11.247 INFO:teuthology.orchestra.run.gibba038.stdout:created 2021-02-13 17:05:11.245270 2021-02-13T17:05:11.248 INFO:teuthology.orchestra.run.gibba038.stdout:min_mon_release 0 (unknown) 2021-02-13T17:05:11.248 INFO:teuthology.orchestra.run.gibba038.stdout:0: [v2:172.21.2.138:3300/0,v1:172.21.2.138:6789/0] mon.a 2021-02-13T17:05:11.248 INFO:teuthology.orchestra.run.gibba038.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c2.monmap (1 monitors) 2021-02-13T17:05:11.249 INFO:tasks.ceph:Writing /etc/ceph/c2.conf for FSID 9862e2e1-3629-4a37-b410-fe5ad22a1229... 2021-02-13T17:05:11.249 DEBUG:teuthology.orchestra.run.gibba037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2021-02-13T17:05:11.252 DEBUG:teuthology.orchestra.run.gibba038:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2021-02-13T17:05:11.296 INFO:teuthology.orchestra.run.gibba037.stdout:[global] 2021-02-13T17:05:11.296 INFO:teuthology.orchestra.run.gibba037.stdout: chdir = "" 2021-02-13T17:05:11.296 INFO:teuthology.orchestra.run.gibba037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-13T17:05:11.296 INFO:teuthology.orchestra.run.gibba037.stdout: auth supported = cephx 2021-02-13T17:05:11.296 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.296 INFO:teuthology.orchestra.run.gibba037.stdout: filestore xattr use omap = true 2021-02-13T17:05:11.296 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.297 INFO:teuthology.orchestra.run.gibba037.stdout: mon clock drift allowed = 1.000 2021-02-13T17:05:11.297 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.297 INFO:teuthology.orchestra.run.gibba037.stdout: osd crush chooseleaf type = 0 2021-02-13T17:05:11.297 INFO:teuthology.orchestra.run.gibba037.stdout: auth debug = true 2021-02-13T17:05:11.297 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.297 INFO:teuthology.orchestra.run.gibba037.stdout: ms die on old message = true 2021-02-13T17:05:11.297 INFO:teuthology.orchestra.run.gibba037.stdout: ms die on bug = true 2021-02-13T17:05:11.297 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.297 INFO:teuthology.orchestra.run.gibba037.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-13T17:05:11.297 INFO:teuthology.orchestra.run.gibba037.stdout: mon pg warn max object skew = 0 2021-02-13T17:05:11.298 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.298 INFO:teuthology.orchestra.run.gibba037.stdout: osd pool default size = 2 2021-02-13T17:05:11.298 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.298 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd allow primary affinity = true 2021-02-13T17:05:11.298 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd allow pg remap = true 2021-02-13T17:05:11.298 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on legacy crush tunables = false 2021-02-13T17:05:11.298 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on crush straw calc version zero = false 2021-02-13T17:05:11.298 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on no sortbitwise = false 2021-02-13T17:05:11.298 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on osd down out interval zero = false 2021-02-13T17:05:11.299 INFO:teuthology.orchestra.run.gibba037.stdout: mon warn on too few osds = false 2021-02-13T17:05:11.299 INFO:teuthology.orchestra.run.gibba037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-13T17:05:11.299 INFO:teuthology.orchestra.run.gibba037.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-13T17:05:11.299 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.299 INFO:teuthology.orchestra.run.gibba037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-13T17:05:11.299 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.299 INFO:teuthology.orchestra.run.gibba037.stdout: osd default data pool replay window = 5 2021-02-13T17:05:11.299 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.299 INFO:teuthology.orchestra.run.gibba037.stdout: mon allow pool delete = true 2021-02-13T17:05:11.299 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.300 INFO:teuthology.orchestra.run.gibba037.stdout: mon cluster log file level = debug 2021-02-13T17:05:11.300 INFO:teuthology.orchestra.run.gibba037.stdout: debug asserts on shutdown = true 2021-02-13T17:05:11.300 INFO:teuthology.orchestra.run.gibba037.stdout: mon health detail to clog = false 2021-02-13T17:05:11.300 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.300 INFO:teuthology.orchestra.run.gibba037.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-02-13T17:05:11.300 INFO:teuthology.orchestra.run.gibba037.stdout: mon_client_directed_command_retry = 4 2021-02-13T17:05:11.300 INFO:teuthology.orchestra.run.gibba037.stdout: mon host = 172.21.2.138 2021-02-13T17:05:11.300 INFO:teuthology.orchestra.run.gibba037.stdout: osd heartbeat grace = 40 2021-02-13T17:05:11.300 INFO:teuthology.orchestra.run.gibba037.stdout: fsid = 9862e2e1-3629-4a37-b410-fe5ad22a1229 2021-02-13T17:05:11.300 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.301 INFO:teuthology.orchestra.run.gibba037.stdout:[osd] 2021-02-13T17:05:11.301 INFO:teuthology.orchestra.run.gibba037.stdout: osd journal size = 100 2021-02-13T17:05:11.301 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.301 INFO:teuthology.orchestra.run.gibba037.stdout: osd scrub load threshold = 5.0 2021-02-13T17:05:11.301 INFO:teuthology.orchestra.run.gibba037.stdout: osd scrub max interval = 600 2021-02-13T17:05:11.301 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.301 INFO:teuthology.orchestra.run.gibba037.stdout: osd recover clone overlap = true 2021-02-13T17:05:11.301 INFO:teuthology.orchestra.run.gibba037.stdout: osd recovery max chunk = 1048576 2021-02-13T17:05:11.301 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.301 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug shutdown = true 2021-02-13T17:05:11.302 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug op order = true 2021-02-13T17:05:11.302 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug verify stray on activate = true 2021-02-13T17:05:11.302 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.302 INFO:teuthology.orchestra.run.gibba037.stdout: osd open classes on start = true 2021-02-13T17:05:11.302 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug pg log writeout = true 2021-02-13T17:05:11.302 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.302 INFO:teuthology.orchestra.run.gibba037.stdout: osd deep scrub update digest min age = 30 2021-02-13T17:05:11.302 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.303 INFO:teuthology.orchestra.run.gibba037.stdout: osd map max advance = 10 2021-02-13T17:05:11.303 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.303 INFO:teuthology.orchestra.run.gibba037.stdout: journal zero on create = true 2021-02-13T17:05:11.303 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.303 INFO:teuthology.orchestra.run.gibba037.stdout: filestore ondisk finisher threads = 3 2021-02-13T17:05:11.303 INFO:teuthology.orchestra.run.gibba037.stdout: filestore apply finisher threads = 3 2021-02-13T17:05:11.303 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.303 INFO:teuthology.orchestra.run.gibba037.stdout: bdev debug aio = true 2021-02-13T17:05:11.303 INFO:teuthology.orchestra.run.gibba037.stdout: osd debug misdirected ops = true 2021-02-13T17:05:11.303 INFO:teuthology.orchestra.run.gibba037.stdout: debug filestore = 20 2021-02-13T17:05:11.303 INFO:teuthology.orchestra.run.gibba037.stdout: debug journal = 20 2021-02-13T17:05:11.303 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 20 2021-02-13T17:05:11.303 INFO:teuthology.orchestra.run.gibba037.stdout: debug osd = 25 2021-02-13T17:05:11.304 INFO:teuthology.orchestra.run.gibba037.stdout: osd fast shutdown = False 2021-02-13T17:05:11.304 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.304 INFO:teuthology.orchestra.run.gibba037.stdout:[mgr] 2021-02-13T17:05:11.304 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 1 2021-02-13T17:05:11.304 INFO:teuthology.orchestra.run.gibba037.stdout: debug mgr = 20 2021-02-13T17:05:11.304 INFO:teuthology.orchestra.run.gibba037.stdout: debug mon = 20 2021-02-13T17:05:11.304 INFO:teuthology.orchestra.run.gibba037.stdout: debug auth = 20 2021-02-13T17:05:11.304 INFO:teuthology.orchestra.run.gibba037.stdout: mon reweight min pgs per osd = 4 2021-02-13T17:05:11.304 INFO:teuthology.orchestra.run.gibba037.stdout: mon reweight min bytes per osd = 10 2021-02-13T17:05:11.304 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.304 INFO:teuthology.orchestra.run.gibba037.stdout:[mon] 2021-02-13T17:05:11.304 INFO:teuthology.orchestra.run.gibba037.stdout: debug ms = 1 2021-02-13T17:05:11.305 INFO:teuthology.orchestra.run.gibba037.stdout: debug mon = 20 2021-02-13T17:05:11.305 INFO:teuthology.orchestra.run.gibba037.stdout: debug paxos = 20 2021-02-13T17:05:11.305 INFO:teuthology.orchestra.run.gibba037.stdout: debug auth = 20 2021-02-13T17:05:11.305 INFO:teuthology.orchestra.run.gibba037.stdout: mon data avail warn = 5 2021-02-13T17:05:11.305 INFO:teuthology.orchestra.run.gibba037.stdout: mon mgr mkfs grace = 240 2021-02-13T17:05:11.305 INFO:teuthology.orchestra.run.gibba037.stdout: mon reweight min pgs per osd = 4 2021-02-13T17:05:11.305 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd reporter subtree level = osd 2021-02-13T17:05:11.305 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd prime pg temp = true 2021-02-13T17:05:11.305 INFO:teuthology.orchestra.run.gibba037.stdout: mon reweight min bytes per osd = 10 2021-02-13T17:05:11.305 INFO:teuthology.orchestra.run.gibba037.stdout: mon osd crush smoke test = False 2021-02-13T17:05:11.305 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T17:05:11.305 INFO:teuthology.orchestra.run.gibba037.stdout:[client] 2021-02-13T17:05:11.305 INFO:teuthology.orchestra.run.gibba037.stdout: rgw cache enabled = true 2021-02-13T17:05:11.305 INFO:teuthology.orchestra.run.gibba037.stdout: rgw enable ops log = true 2021-02-13T17:05:11.306 INFO:teuthology.orchestra.run.gibba037.stdout: rgw enable usage log = true 2021-02-13T17:05:11.306 INFO:teuthology.orchestra.run.gibba037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-13T17:05:11.306 INFO:teuthology.orchestra.run.gibba037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-13T17:05:11.306 INFO:teuthology.orchestra.run.gibba037.stdout: debug rgw = 20 2021-02-13T17:05:11.306 INFO:teuthology.orchestra.run.gibba037.stdout: rgw crypt require ssl = False 2021-02-13T17:05:11.306 INFO:teuthology.orchestra.run.gibba037.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-02-13T17:05:11.306 INFO:teuthology.orchestra.run.gibba037.stdout: rgw curl low speed time = 300 2021-02-13T17:05:11.306 INFO:teuthology.orchestra.run.gibba037.stdout: rgw data log num shards = 4 2021-02-13T17:05:11.306 INFO:teuthology.orchestra.run.gibba037.stdout: rgw md log max shards = 4 2021-02-13T17:05:11.306 INFO:teuthology.orchestra.run.gibba037.stdout: rgw sync log trim interval = 0 2021-02-13T17:05:11.307 INFO:teuthology.orchestra.run.gibba037.stdout: rgw sync obj etag verify = True 2021-02-13T17:05:11.307 INFO:teuthology.orchestra.run.gibba037.stdout:[mon.a] 2021-02-13T17:05:11.307 INFO:teuthology.orchestra.run.gibba037.stdout:[osd.0] 2021-02-13T17:05:11.307 INFO:teuthology.orchestra.run.gibba037.stdout: osd_max_omap_entries_per_request = 10 2021-02-13T17:05:11.307 INFO:teuthology.orchestra.run.gibba037.stdout:[osd.1] 2021-02-13T17:05:11.307 INFO:teuthology.orchestra.run.gibba037.stdout: osd_max_omap_entries_per_request = 1000 2021-02-13T17:05:11.307 INFO:teuthology.orchestra.run.gibba037.stdout:[osd.2] 2021-02-13T17:05:11.307 INFO:teuthology.orchestra.run.gibba037.stdout: osd_max_omap_entries_per_request = 10000 2021-02-13T17:05:11.312 INFO:teuthology.orchestra.run.gibba038.stdout:[global] 2021-02-13T17:05:11.312 INFO:teuthology.orchestra.run.gibba038.stdout: chdir = "" 2021-02-13T17:05:11.312 INFO:teuthology.orchestra.run.gibba038.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-13T17:05:11.313 INFO:teuthology.orchestra.run.gibba038.stdout: auth supported = cephx 2021-02-13T17:05:11.313 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.313 INFO:teuthology.orchestra.run.gibba038.stdout: filestore xattr use omap = true 2021-02-13T17:05:11.313 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.313 INFO:teuthology.orchestra.run.gibba038.stdout: mon clock drift allowed = 1.000 2021-02-13T17:05:11.313 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.313 INFO:teuthology.orchestra.run.gibba038.stdout: osd crush chooseleaf type = 0 2021-02-13T17:05:11.313 INFO:teuthology.orchestra.run.gibba038.stdout: auth debug = true 2021-02-13T17:05:11.313 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.313 INFO:teuthology.orchestra.run.gibba038.stdout: ms die on old message = true 2021-02-13T17:05:11.313 INFO:teuthology.orchestra.run.gibba038.stdout: ms die on bug = true 2021-02-13T17:05:11.313 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.313 INFO:teuthology.orchestra.run.gibba038.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-13T17:05:11.314 INFO:teuthology.orchestra.run.gibba038.stdout: mon pg warn max object skew = 0 2021-02-13T17:05:11.314 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.314 INFO:teuthology.orchestra.run.gibba038.stdout: osd pool default size = 2 2021-02-13T17:05:11.314 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.314 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd allow primary affinity = true 2021-02-13T17:05:11.314 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd allow pg remap = true 2021-02-13T17:05:11.314 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on legacy crush tunables = false 2021-02-13T17:05:11.314 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on crush straw calc version zero = false 2021-02-13T17:05:11.314 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on no sortbitwise = false 2021-02-13T17:05:11.314 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on osd down out interval zero = false 2021-02-13T17:05:11.314 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on too few osds = false 2021-02-13T17:05:11.314 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-13T17:05:11.314 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-13T17:05:11.315 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.315 INFO:teuthology.orchestra.run.gibba038.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-13T17:05:11.315 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.315 INFO:teuthology.orchestra.run.gibba038.stdout: osd default data pool replay window = 5 2021-02-13T17:05:11.315 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.315 INFO:teuthology.orchestra.run.gibba038.stdout: mon allow pool delete = true 2021-02-13T17:05:11.315 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.315 INFO:teuthology.orchestra.run.gibba038.stdout: mon cluster log file level = debug 2021-02-13T17:05:11.315 INFO:teuthology.orchestra.run.gibba038.stdout: debug asserts on shutdown = true 2021-02-13T17:05:11.315 INFO:teuthology.orchestra.run.gibba038.stdout: mon health detail to clog = false 2021-02-13T17:05:11.315 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.315 INFO:teuthology.orchestra.run.gibba038.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-02-13T17:05:11.315 INFO:teuthology.orchestra.run.gibba038.stdout: mon_client_directed_command_retry = 4 2021-02-13T17:05:11.315 INFO:teuthology.orchestra.run.gibba038.stdout: mon host = 172.21.2.138 2021-02-13T17:05:11.316 INFO:teuthology.orchestra.run.gibba038.stdout: osd heartbeat grace = 40 2021-02-13T17:05:11.316 INFO:teuthology.orchestra.run.gibba038.stdout: fsid = 9862e2e1-3629-4a37-b410-fe5ad22a1229 2021-02-13T17:05:11.316 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.316 INFO:teuthology.orchestra.run.gibba038.stdout:[osd] 2021-02-13T17:05:11.316 INFO:teuthology.orchestra.run.gibba038.stdout: osd journal size = 100 2021-02-13T17:05:11.316 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.316 INFO:teuthology.orchestra.run.gibba038.stdout: osd scrub load threshold = 5.0 2021-02-13T17:05:11.316 INFO:teuthology.orchestra.run.gibba038.stdout: osd scrub max interval = 600 2021-02-13T17:05:11.316 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.316 INFO:teuthology.orchestra.run.gibba038.stdout: osd recover clone overlap = true 2021-02-13T17:05:11.316 INFO:teuthology.orchestra.run.gibba038.stdout: osd recovery max chunk = 1048576 2021-02-13T17:05:11.316 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.316 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug shutdown = true 2021-02-13T17:05:11.316 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug op order = true 2021-02-13T17:05:11.317 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug verify stray on activate = true 2021-02-13T17:05:11.317 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.317 INFO:teuthology.orchestra.run.gibba038.stdout: osd open classes on start = true 2021-02-13T17:05:11.317 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug pg log writeout = true 2021-02-13T17:05:11.317 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.317 INFO:teuthology.orchestra.run.gibba038.stdout: osd deep scrub update digest min age = 30 2021-02-13T17:05:11.317 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.317 INFO:teuthology.orchestra.run.gibba038.stdout: osd map max advance = 10 2021-02-13T17:05:11.317 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.317 INFO:teuthology.orchestra.run.gibba038.stdout: journal zero on create = true 2021-02-13T17:05:11.317 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.317 INFO:teuthology.orchestra.run.gibba038.stdout: filestore ondisk finisher threads = 3 2021-02-13T17:05:11.317 INFO:teuthology.orchestra.run.gibba038.stdout: filestore apply finisher threads = 3 2021-02-13T17:05:11.317 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.317 INFO:teuthology.orchestra.run.gibba038.stdout: bdev debug aio = true 2021-02-13T17:05:11.318 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug misdirected ops = true 2021-02-13T17:05:11.318 INFO:teuthology.orchestra.run.gibba038.stdout: debug filestore = 20 2021-02-13T17:05:11.318 INFO:teuthology.orchestra.run.gibba038.stdout: debug journal = 20 2021-02-13T17:05:11.318 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 20 2021-02-13T17:05:11.318 INFO:teuthology.orchestra.run.gibba038.stdout: debug osd = 25 2021-02-13T17:05:11.318 INFO:teuthology.orchestra.run.gibba038.stdout: osd fast shutdown = False 2021-02-13T17:05:11.318 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.318 INFO:teuthology.orchestra.run.gibba038.stdout:[mgr] 2021-02-13T17:05:11.318 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-02-13T17:05:11.318 INFO:teuthology.orchestra.run.gibba038.stdout: debug mgr = 20 2021-02-13T17:05:11.318 INFO:teuthology.orchestra.run.gibba038.stdout: debug mon = 20 2021-02-13T17:05:11.318 INFO:teuthology.orchestra.run.gibba038.stdout: debug auth = 20 2021-02-13T17:05:11.319 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min pgs per osd = 4 2021-02-13T17:05:11.319 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min bytes per osd = 10 2021-02-13T17:05:11.319 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.319 INFO:teuthology.orchestra.run.gibba038.stdout:[mon] 2021-02-13T17:05:11.319 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-02-13T17:05:11.319 INFO:teuthology.orchestra.run.gibba038.stdout: debug mon = 20 2021-02-13T17:05:11.319 INFO:teuthology.orchestra.run.gibba038.stdout: debug paxos = 20 2021-02-13T17:05:11.319 INFO:teuthology.orchestra.run.gibba038.stdout: debug auth = 20 2021-02-13T17:05:11.319 INFO:teuthology.orchestra.run.gibba038.stdout: mon data avail warn = 5 2021-02-13T17:05:11.319 INFO:teuthology.orchestra.run.gibba038.stdout: mon mgr mkfs grace = 240 2021-02-13T17:05:11.319 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min pgs per osd = 4 2021-02-13T17:05:11.319 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd reporter subtree level = osd 2021-02-13T17:05:11.319 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd prime pg temp = true 2021-02-13T17:05:11.320 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min bytes per osd = 10 2021-02-13T17:05:11.320 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd crush smoke test = False 2021-02-13T17:05:11.320 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:11.320 INFO:teuthology.orchestra.run.gibba038.stdout:[client] 2021-02-13T17:05:11.321 INFO:teuthology.orchestra.run.gibba038.stdout: rgw cache enabled = true 2021-02-13T17:05:11.321 INFO:teuthology.orchestra.run.gibba038.stdout: rgw enable ops log = true 2021-02-13T17:05:11.321 INFO:teuthology.orchestra.run.gibba038.stdout: rgw enable usage log = true 2021-02-13T17:05:11.321 INFO:teuthology.orchestra.run.gibba038.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-13T17:05:11.321 INFO:teuthology.orchestra.run.gibba038.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-13T17:05:11.321 INFO:teuthology.orchestra.run.gibba038.stdout: debug rgw = 20 2021-02-13T17:05:11.321 INFO:teuthology.orchestra.run.gibba038.stdout: rgw crypt require ssl = False 2021-02-13T17:05:11.322 INFO:teuthology.orchestra.run.gibba038.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-02-13T17:05:11.322 INFO:teuthology.orchestra.run.gibba038.stdout: rgw curl low speed time = 300 2021-02-13T17:05:11.322 INFO:teuthology.orchestra.run.gibba038.stdout: rgw data log num shards = 4 2021-02-13T17:05:11.322 INFO:teuthology.orchestra.run.gibba038.stdout: rgw md log max shards = 4 2021-02-13T17:05:11.322 INFO:teuthology.orchestra.run.gibba038.stdout: rgw sync log trim interval = 0 2021-02-13T17:05:11.322 INFO:teuthology.orchestra.run.gibba038.stdout: rgw sync obj etag verify = True 2021-02-13T17:05:11.322 INFO:teuthology.orchestra.run.gibba038.stdout:[mon.a] 2021-02-13T17:05:11.322 INFO:teuthology.orchestra.run.gibba038.stdout:[osd.0] 2021-02-13T17:05:11.322 INFO:teuthology.orchestra.run.gibba038.stdout: osd_max_omap_entries_per_request = 10 2021-02-13T17:05:11.322 INFO:teuthology.orchestra.run.gibba038.stdout:[osd.1] 2021-02-13T17:05:11.322 INFO:teuthology.orchestra.run.gibba038.stdout: osd_max_omap_entries_per_request = 1000 2021-02-13T17:05:11.322 INFO:teuthology.orchestra.run.gibba038.stdout:[osd.2] 2021-02-13T17:05:11.323 INFO:teuthology.orchestra.run.gibba038.stdout: osd_max_omap_entries_per_request = 10000 2021-02-13T17:05:11.324 INFO:tasks.ceph:Creating admin key on c2.mon.a... 2021-02-13T17:05:11.324 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c2.keyring 2021-02-13T17:05:11.414 INFO:tasks.ceph:Copying monmap to all nodes... 2021-02-13T17:05:11.420 DEBUG:teuthology.orchestra.remote:gibba038:/etc/ceph/c2.keyring is 206B 2021-02-13T17:05:11.482 DEBUG:teuthology.orchestra.remote:gibba038:/home/ubuntu/cephtest/c2.monmap is 177B 2021-02-13T17:05:11.496 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba037.front.sepia.ceph.com 2021-02-13T17:05:11.496 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-02-13T17:05:11.496 DEBUG:teuthology.orchestra.run.gibba037:> sudo dd of=/etc/ceph/c2.keyring 2021-02-13T17:05:11.496 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-02-13T17:05:11.513 DEBUG:teuthology.orchestra.run.gibba037:> set -ex 2021-02-13T17:05:11.513 DEBUG:teuthology.orchestra.run.gibba037:> dd of=/home/ubuntu/cephtest/c2.monmap 2021-02-13T17:05:11.558 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba038.front.sepia.ceph.com 2021-02-13T17:05:11.558 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-02-13T17:05:11.558 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/etc/ceph/c2.keyring 2021-02-13T17:05:11.558 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-02-13T17:05:11.585 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-02-13T17:05:11.585 DEBUG:teuthology.orchestra.run.gibba038:> dd of=/home/ubuntu/cephtest/c2.monmap 2021-02-13T17:05:11.633 INFO:tasks.ceph:Setting up mon nodes... 2021-02-13T17:05:11.633 INFO:tasks.ceph:Setting up mgr nodes... 2021-02-13T17:05:11.633 DEBUG:teuthology.orchestra.run.gibba038:> sudo mkdir -p /var/lib/ceph/mgr/c2-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c2-x/keyring 2021-02-13T17:05:11.700 INFO:teuthology.orchestra.run.gibba038.stdout:creating /var/lib/ceph/mgr/c2-x/keyring 2021-02-13T17:05:11.701 INFO:tasks.ceph:Setting up mds nodes... 2021-02-13T17:05:11.702 INFO:tasks.ceph_client:Setting up client nodes... 2021-02-13T17:05:11.702 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c2.client.0.keyring && sudo chmod 0644 /etc/ceph/c2.client.0.keyring 2021-02-13T17:05:11.762 INFO:teuthology.orchestra.run.gibba038.stdout:creating /etc/ceph/c2.client.0.keyring 2021-02-13T17:05:11.766 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/c2.client.1.keyring && sudo chmod 0644 /etc/ceph/c2.client.1.keyring 2021-02-13T17:05:11.833 INFO:teuthology.orchestra.run.gibba038.stdout:creating /etc/ceph/c2.client.1.keyring 2021-02-13T17:05:11.841 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-02-13T17:05:11.842 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@gibba037.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@gibba038.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}} 2021-02-13T17:05:11.842 DEBUG:teuthology.orchestra.run.gibba038:> sudo mkdir -p /var/lib/ceph/osd/c2-0 2021-02-13T17:05:11.895 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-02-13T17:05:11.895 INFO:tasks.ceph:role: c2.osd.0 2021-02-13T17:05:11.895 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@gibba038.front.sepia.ceph.com 2021-02-13T17:05:11.895 DEBUG:teuthology.orchestra.run.gibba038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-02-13T17:05:11.977 INFO:teuthology.orchestra.run.gibba038.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5505024 blks 2021-02-13T17:05:11.977 INFO:teuthology.orchestra.run.gibba038.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-13T17:05:11.977 INFO:teuthology.orchestra.run.gibba038.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-02-13T17:05:11.978 INFO:teuthology.orchestra.run.gibba038.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-02-13T17:05:11.978 INFO:teuthology.orchestra.run.gibba038.stdout: = sunit=0 swidth=0 blks 2021-02-13T17:05:11.978 INFO:teuthology.orchestra.run.gibba038.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-02-13T17:05:11.978 INFO:teuthology.orchestra.run.gibba038.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-02-13T17:05:11.978 INFO:teuthology.orchestra.run.gibba038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-13T17:05:11.978 INFO:teuthology.orchestra.run.gibba038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-13T17:05:11.980 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@gibba038.front.sepia.ceph.com -o noatime 2021-02-13T17:05:11.980 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c2-0 2021-02-13T17:05:12.036 DEBUG:teuthology.orchestra.run.gibba038:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-0 2021-02-13T17:05:12.090 INFO:teuthology.orchestra.run.gibba038.stderr:sudo: /sbin/restorecon: command not found 2021-02-13T17:05:12.091 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-13T17:05:12.091 DEBUG:teuthology.orchestra.run.gibba038:> sudo mkdir -p /var/lib/ceph/osd/c2-1 2021-02-13T17:05:12.151 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-02-13T17:05:12.151 INFO:tasks.ceph:role: c2.osd.1 2021-02-13T17:05:12.151 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@gibba038.front.sepia.ceph.com 2021-02-13T17:05:12.151 DEBUG:teuthology.orchestra.run.gibba038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-02-13T17:05:12.233 INFO:teuthology.orchestra.run.gibba038.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5505024 blks 2021-02-13T17:05:12.233 INFO:teuthology.orchestra.run.gibba038.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-13T17:05:12.233 INFO:teuthology.orchestra.run.gibba038.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-02-13T17:05:12.233 INFO:teuthology.orchestra.run.gibba038.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-02-13T17:05:12.233 INFO:teuthology.orchestra.run.gibba038.stdout: = sunit=0 swidth=0 blks 2021-02-13T17:05:12.233 INFO:teuthology.orchestra.run.gibba038.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-02-13T17:05:12.234 INFO:teuthology.orchestra.run.gibba038.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-02-13T17:05:12.234 INFO:teuthology.orchestra.run.gibba038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-13T17:05:12.234 INFO:teuthology.orchestra.run.gibba038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-13T17:05:12.235 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@gibba038.front.sepia.ceph.com -o noatime 2021-02-13T17:05:12.235 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c2-1 2021-02-13T17:05:12.307 DEBUG:teuthology.orchestra.run.gibba038:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-1 2021-02-13T17:05:12.357 INFO:teuthology.orchestra.run.gibba038.stderr:sudo: /sbin/restorecon: command not found 2021-02-13T17:05:12.357 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-13T17:05:12.357 DEBUG:teuthology.orchestra.run.gibba038:> sudo mkdir -p /var/lib/ceph/osd/c2-2 2021-02-13T17:05:12.421 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-02-13T17:05:12.421 INFO:tasks.ceph:role: c2.osd.2 2021-02-13T17:05:12.421 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@gibba038.front.sepia.ceph.com 2021-02-13T17:05:12.421 DEBUG:teuthology.orchestra.run.gibba038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-02-13T17:05:12.503 INFO:teuthology.orchestra.run.gibba038.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5505024 blks 2021-02-13T17:05:12.503 INFO:teuthology.orchestra.run.gibba038.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-13T17:05:12.503 INFO:teuthology.orchestra.run.gibba038.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-02-13T17:05:12.503 INFO:teuthology.orchestra.run.gibba038.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-02-13T17:05:12.503 INFO:teuthology.orchestra.run.gibba038.stdout: = sunit=0 swidth=0 blks 2021-02-13T17:05:12.503 INFO:teuthology.orchestra.run.gibba038.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-02-13T17:05:12.503 INFO:teuthology.orchestra.run.gibba038.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-02-13T17:05:12.503 INFO:teuthology.orchestra.run.gibba038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-13T17:05:12.504 INFO:teuthology.orchestra.run.gibba038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-13T17:05:12.504 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@gibba038.front.sepia.ceph.com -o noatime 2021-02-13T17:05:12.505 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c2-2 2021-02-13T17:05:12.577 DEBUG:teuthology.orchestra.run.gibba038:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-2 2021-02-13T17:05:12.629 INFO:teuthology.orchestra.run.gibba038.stderr:sudo: /sbin/restorecon: command not found 2021-02-13T17:05:12.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-13T17:05:12.630 DEBUG:teuthology.orchestra.run.gibba038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c2.monmap 2021-02-13T17:05:12.823 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:12.818 7fa3bb43ac00 -1 auth: error reading file: /var/lib/ceph/osd/c2-0/keyring: can't open /var/lib/ceph/osd/c2-0/keyring: (2) No such file or directory 2021-02-13T17:05:12.823 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:12.818 7fa3bb43ac00 -1 created new key in keyring /var/lib/ceph/osd/c2-0/keyring 2021-02-13T17:05:12.823 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:12.818 7fa3bb43ac00 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-02-13T17:05:12.823 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:12.818 7fa3bb43ac00 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-02-13T17:05:12.823 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:12.818 7fa3bb43ac00 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-02-13T17:05:12.824 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:12.818 7fa3bb43ac00 -1 bluestore(/var/lib/ceph/osd/c2-0) _read_fsid unparsable uuid 2021-02-13T17:05:14.987 DEBUG:teuthology.orchestra.run.gibba038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-0 2021-02-13T17:05:14.997 DEBUG:teuthology.orchestra.run.gibba038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c2.monmap 2021-02-13T17:05:15.060 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:15.054 7f5883024c00 -1 auth: error reading file: /var/lib/ceph/osd/c2-1/keyring: can't open /var/lib/ceph/osd/c2-1/keyring: (2) No such file or directory 2021-02-13T17:05:15.060 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:15.054 7f5883024c00 -1 created new key in keyring /var/lib/ceph/osd/c2-1/keyring 2021-02-13T17:05:15.060 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:15.054 7f5883024c00 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-02-13T17:05:15.060 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:15.054 7f5883024c00 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-02-13T17:05:15.060 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:15.054 7f5883024c00 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-02-13T17:05:15.061 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:15.054 7f5883024c00 -1 bluestore(/var/lib/ceph/osd/c2-1) _read_fsid unparsable uuid 2021-02-13T17:05:17.235 DEBUG:teuthology.orchestra.run.gibba038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-1 2021-02-13T17:05:17.287 DEBUG:teuthology.orchestra.run.gibba038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c2.monmap 2021-02-13T17:05:17.347 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:17.342 7f72e019ac00 -1 auth: error reading file: /var/lib/ceph/osd/c2-2/keyring: can't open /var/lib/ceph/osd/c2-2/keyring: (2) No such file or directory 2021-02-13T17:05:17.348 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:17.342 7f72e019ac00 -1 created new key in keyring /var/lib/ceph/osd/c2-2/keyring 2021-02-13T17:05:17.348 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:17.342 7f72e019ac00 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-02-13T17:05:17.348 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:17.342 7f72e019ac00 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-02-13T17:05:17.348 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:17.342 7f72e019ac00 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-02-13T17:05:17.348 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:17.342 7f72e019ac00 -1 bluestore(/var/lib/ceph/osd/c2-2) _read_fsid unparsable uuid 2021-02-13T17:05:19.522 DEBUG:teuthology.orchestra.run.gibba038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-2 2021-02-13T17:05:19.575 INFO:tasks.ceph:Reading keys from all nodes... 2021-02-13T17:05:19.575 DEBUG:teuthology.orchestra.run.gibba038:> mktemp 2021-02-13T17:05:19.620 INFO:teuthology.orchestra.run.gibba038.stdout:/tmp/tmp.OSO9pHv4Ld 2021-02-13T17:05:19.621 DEBUG:teuthology.orchestra.run.gibba038:> sudo cp /var/lib/ceph/mgr/c2-x/keyring /tmp/tmp.OSO9pHv4Ld 2021-02-13T17:05:19.679 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 0666 /tmp/tmp.OSO9pHv4Ld 2021-02-13T17:05:19.791 DEBUG:teuthology.orchestra.remote:gibba038:/tmp/tmp.OSO9pHv4Ld is 56B 2021-02-13T17:05:19.843 DEBUG:teuthology.orchestra.run.gibba038:> rm -fr /tmp/tmp.OSO9pHv4Ld 2021-02-13T17:05:19.847 DEBUG:teuthology.orchestra.run.gibba038:> mktemp 2021-02-13T17:05:19.896 INFO:teuthology.orchestra.run.gibba038.stdout:/tmp/tmp.CPIVIHj7dR 2021-02-13T17:05:19.896 DEBUG:teuthology.orchestra.run.gibba038:> sudo cp /var/lib/ceph/osd/c2-0/keyring /tmp/tmp.CPIVIHj7dR 2021-02-13T17:05:19.944 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 0666 /tmp/tmp.CPIVIHj7dR 2021-02-13T17:05:20.050 DEBUG:teuthology.orchestra.remote:gibba038:/tmp/tmp.CPIVIHj7dR is 56B 2021-02-13T17:05:20.059 DEBUG:teuthology.orchestra.run.gibba038:> rm -fr /tmp/tmp.CPIVIHj7dR 2021-02-13T17:05:20.063 DEBUG:teuthology.orchestra.run.gibba038:> mktemp 2021-02-13T17:05:20.112 INFO:teuthology.orchestra.run.gibba038.stdout:/tmp/tmp.AQtHsNalVU 2021-02-13T17:05:20.113 DEBUG:teuthology.orchestra.run.gibba038:> sudo cp /var/lib/ceph/osd/c2-1/keyring /tmp/tmp.AQtHsNalVU 2021-02-13T17:05:20.161 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 0666 /tmp/tmp.AQtHsNalVU 2021-02-13T17:05:20.276 DEBUG:teuthology.orchestra.remote:gibba038:/tmp/tmp.AQtHsNalVU is 56B 2021-02-13T17:05:20.290 DEBUG:teuthology.orchestra.run.gibba038:> rm -fr /tmp/tmp.AQtHsNalVU 2021-02-13T17:05:20.298 DEBUG:teuthology.orchestra.run.gibba038:> mktemp 2021-02-13T17:05:20.348 INFO:teuthology.orchestra.run.gibba038.stdout:/tmp/tmp.nPXS4M7ZvN 2021-02-13T17:05:20.349 DEBUG:teuthology.orchestra.run.gibba038:> sudo cp /var/lib/ceph/osd/c2-2/keyring /tmp/tmp.nPXS4M7ZvN 2021-02-13T17:05:20.414 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 0666 /tmp/tmp.nPXS4M7ZvN 2021-02-13T17:05:20.514 DEBUG:teuthology.orchestra.remote:gibba038:/tmp/tmp.nPXS4M7ZvN is 56B 2021-02-13T17:05:20.524 DEBUG:teuthology.orchestra.run.gibba038:> rm -fr /tmp/tmp.nPXS4M7ZvN 2021-02-13T17:05:20.579 DEBUG:teuthology.orchestra.remote:gibba038:/etc/ceph/c2.client.0.keyring is 59B 2021-02-13T17:05:20.639 DEBUG:teuthology.orchestra.remote:gibba038:/etc/ceph/c2.client.1.keyring is 59B 2021-02-13T17:05:20.648 INFO:tasks.ceph:Adding keys to all mons... 2021-02-13T17:05:20.648 DEBUG:teuthology.orchestra.run.gibba038:> sudo tee -a /etc/ceph/c2.keyring 2021-02-13T17:05:20.657 INFO:teuthology.orchestra.run.gibba038.stdout:[mgr.x] 2021-02-13T17:05:20.658 INFO:teuthology.orchestra.run.gibba038.stdout: key = AQDHBihgzfmhKRAA+K7JBpRBnyBEt8g6+JvFaw== 2021-02-13T17:05:20.658 INFO:teuthology.orchestra.run.gibba038.stdout:[osd.0] 2021-02-13T17:05:20.658 INFO:teuthology.orchestra.run.gibba038.stdout: key = AQDIBihgc6HqMBAAD6HNfzDcoRGQnklFDu+O1A== 2021-02-13T17:05:20.658 INFO:teuthology.orchestra.run.gibba038.stdout:[osd.1] 2021-02-13T17:05:20.658 INFO:teuthology.orchestra.run.gibba038.stdout: key = AQDLBihg0+9xAxAAa8tVtPtHhXadl2T0AXrHMQ== 2021-02-13T17:05:20.658 INFO:teuthology.orchestra.run.gibba038.stdout:[osd.2] 2021-02-13T17:05:20.658 INFO:teuthology.orchestra.run.gibba038.stdout: key = AQDNBihgCvmZFBAAXw17gdO5WvxUClgj4WQuXA== 2021-02-13T17:05:20.658 INFO:teuthology.orchestra.run.gibba038.stdout:[client.0] 2021-02-13T17:05:20.658 INFO:teuthology.orchestra.run.gibba038.stdout: key = AQDHBihgnjdXLRAA4+PWnRprAKkWfday8uoKGg== 2021-02-13T17:05:20.658 INFO:teuthology.orchestra.run.gibba038.stdout:[client.1] 2021-02-13T17:05:20.659 INFO:teuthology.orchestra.run.gibba038.stdout: key = AQDHBihg/5iRMRAAJtIkwC0Uyms1Ay6c5oULsA== 2021-02-13T17:05:20.659 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-02-13T17:05:20.724 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-13T17:05:20.795 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-13T17:05:20.904 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-13T17:05:20.926 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-13T17:05:21.002 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-13T17:05:21.070 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-02-13T17:05:21.071 DEBUG:teuthology.orchestra.run.gibba038:> sudo mkdir -p /var/lib/ceph/mon/c2-a 2021-02-13T17:05:21.120 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c2 --mkfs -i a --monmap /home/ubuntu/cephtest/c2.monmap --keyring /etc/ceph/c2.keyring 2021-02-13T17:05:21.191 DEBUG:teuthology.orchestra.run.gibba038:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c2-a 2021-02-13T17:05:21.243 DEBUG:teuthology.orchestra.run.gibba038:> rm -- /home/ubuntu/cephtest/c2.monmap 2021-02-13T17:05:21.292 INFO:tasks.ceph:Starting mon daemons in cluster c2... 2021-02-13T17:05:21.292 INFO:tasks.ceph.c2.mon.a:Restarting daemon 2021-02-13T17:05:21.292 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c2 -i a 2021-02-13T17:05:21.335 INFO:tasks.ceph.c2.mon.a:Started 2021-02-13T17:05:21.335 INFO:tasks.ceph:Starting mgr daemons in cluster c2... 2021-02-13T17:05:21.335 INFO:tasks.ceph.c2.mgr.x:Restarting daemon 2021-02-13T17:05:21.335 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c2 -i x 2021-02-13T17:05:21.338 INFO:tasks.ceph.c2.mgr.x:Started 2021-02-13T17:05:21.338 INFO:tasks.ceph:Setting crush tunables to default 2021-02-13T17:05:21.338 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --cluster c2 osd crush tunables default 2021-02-13T17:05:21.537 INFO:teuthology.orchestra.run.gibba038.stderr:adjusted tunables profile to default 2021-02-13T17:05:21.545 INFO:tasks.ceph:Starting osd daemons in cluster c2... 2021-02-13T17:05:21.545 DEBUG:teuthology.orchestra.run.gibba038:> mktemp 2021-02-13T17:05:21.548 INFO:teuthology.orchestra.run.gibba038.stdout:/tmp/tmp.tChgDIUuqe 2021-02-13T17:05:21.548 DEBUG:teuthology.orchestra.run.gibba038:> sudo cp /var/lib/ceph/osd/c2-0/fsid /tmp/tmp.tChgDIUuqe 2021-02-13T17:05:21.597 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 0666 /tmp/tmp.tChgDIUuqe 2021-02-13T17:05:21.698 DEBUG:teuthology.orchestra.remote:gibba038:/tmp/tmp.tChgDIUuqe is 37B 2021-02-13T17:05:21.747 DEBUG:teuthology.orchestra.run.gibba038:> rm -fr /tmp/tmp.tChgDIUuqe 2021-02-13T17:05:21.755 DEBUG:teuthology.orchestra.run.gibba038:> mktemp 2021-02-13T17:05:21.804 INFO:teuthology.orchestra.run.gibba038.stdout:/tmp/tmp.BEFo0f4MRt 2021-02-13T17:05:21.804 DEBUG:teuthology.orchestra.run.gibba038:> sudo cp /var/lib/ceph/osd/c2-1/fsid /tmp/tmp.BEFo0f4MRt 2021-02-13T17:05:21.854 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 0666 /tmp/tmp.BEFo0f4MRt 2021-02-13T17:05:21.950 DEBUG:teuthology.orchestra.remote:gibba038:/tmp/tmp.BEFo0f4MRt is 37B 2021-02-13T17:05:22.001 DEBUG:teuthology.orchestra.run.gibba038:> rm -fr /tmp/tmp.BEFo0f4MRt 2021-02-13T17:05:22.004 DEBUG:teuthology.orchestra.run.gibba038:> mktemp 2021-02-13T17:05:22.048 INFO:teuthology.orchestra.run.gibba038.stdout:/tmp/tmp.mzE7xrnO2D 2021-02-13T17:05:22.048 DEBUG:teuthology.orchestra.run.gibba038:> sudo cp /var/lib/ceph/osd/c2-2/fsid /tmp/tmp.mzE7xrnO2D 2021-02-13T17:05:22.093 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 0666 /tmp/tmp.mzE7xrnO2D 2021-02-13T17:05:22.189 DEBUG:teuthology.orchestra.remote:gibba038:/tmp/tmp.mzE7xrnO2D is 37B 2021-02-13T17:05:22.237 DEBUG:teuthology.orchestra.run.gibba038:> rm -fr /tmp/tmp.mzE7xrnO2D 2021-02-13T17:05:22.240 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --cluster c2 osd new 071ed5f1-52ee-49d1-8385-810f302f85a3 0 2021-02-13T17:05:22.404 INFO:teuthology.orchestra.run.gibba038.stdout:0 2021-02-13T17:05:22.412 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --cluster c2 osd new 2842cc8e-04a5-415b-9635-a8fa91816c5c 1 2021-02-13T17:05:22.538 INFO:teuthology.orchestra.run.gibba038.stdout:1 2021-02-13T17:05:22.547 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --cluster c2 osd new ee3f40ad-6deb-45ad-8034-b96f1d263346 2 2021-02-13T17:05:22.673 INFO:teuthology.orchestra.run.gibba038.stdout:2 2021-02-13T17:05:22.681 INFO:tasks.ceph.c2.osd.0:Restarting daemon 2021-02-13T17:05:22.682 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 0 2021-02-13T17:05:22.683 INFO:tasks.ceph.c2.osd.0:Started 2021-02-13T17:05:22.684 INFO:tasks.ceph.c2.osd.1:Restarting daemon 2021-02-13T17:05:22.684 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 1 2021-02-13T17:05:22.686 INFO:tasks.ceph.c2.osd.1:Started 2021-02-13T17:05:22.686 INFO:tasks.ceph.c2.osd.2:Restarting daemon 2021-02-13T17:05:22.686 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 2 2021-02-13T17:05:22.688 INFO:tasks.ceph.c2.osd.2:Started 2021-02-13T17:05:22.688 INFO:tasks.ceph:Waiting for OSDs to come up 2021-02-13T17:05:22.992 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2021-02-13T17:05:23.115 INFO:teuthology.misc.health.gibba038.stdout: 2021-02-13T17:05:23.115 INFO:teuthology.misc.health.gibba038.stdout:{"epoch":5,"fsid":"9862e2e1-3629-4a37-b410-fe5ad22a1229","created":"2021-02-13 17:05:21.399671","modified":"2021-02-13 17:05:22.668264","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"071ed5f1-52ee-49d1-8385-810f302f85a3","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":1,"uuid":"2842cc8e-04a5-415b-9635-a8fa91816c5c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":2,"uuid":"ee3f40ad-6deb-45ad-8034-b96f1d263346","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T17:05:23.122 DEBUG:teuthology.misc:0 of 3 OSDs are up 2021-02-13T17:05:23.270 INFO:tasks.ceph.c2.osd.0.gibba038.stderr:2021-02-13 17:05:23.266 7f378c69ac00 -1 Falling back to public interface 2021-02-13T17:05:23.270 INFO:tasks.ceph.c2.osd.2.gibba038.stderr:2021-02-13 17:05:23.266 7f1b2203cc00 -1 Falling back to public interface 2021-02-13T17:05:23.273 INFO:tasks.ceph.c2.osd.1.gibba038.stderr:2021-02-13 17:05:23.270 7ff802942c00 -1 Falling back to public interface 2021-02-13T17:05:23.864 INFO:tasks.ceph.c2.osd.2.gibba038.stderr:2021-02-13 17:05:23.858 7f1b2203cc00 -1 osd.2 0 log_to_monitors {default=true} 2021-02-13T17:05:23.907 INFO:tasks.ceph.c2.osd.0.gibba038.stderr:2021-02-13 17:05:23.902 7f378c69ac00 -1 osd.0 0 log_to_monitors {default=true} 2021-02-13T17:05:23.908 INFO:tasks.ceph.c2.osd.1.gibba038.stderr:2021-02-13 17:05:23.902 7ff802942c00 -1 osd.1 0 log_to_monitors {default=true} 2021-02-13T17:05:25.499 INFO:tasks.ceph.c2.osd.0.gibba038.stderr:2021-02-13 17:05:25.494 7f377373a700 -1 osd.0 0 waiting for initial osdmap 2021-02-13T17:05:25.500 INFO:tasks.ceph.c2.osd.2.gibba038.stderr:2021-02-13 17:05:25.494 7f1b090dc700 -1 osd.2 0 waiting for initial osdmap 2021-02-13T17:05:25.500 INFO:tasks.ceph.c2.osd.1.gibba038.stderr:2021-02-13 17:05:25.494 7ff7e99e2700 -1 osd.1 0 waiting for initial osdmap 2021-02-13T17:05:25.504 INFO:tasks.ceph.c2.osd.2.gibba038.stderr:2021-02-13 17:05:25.498 7f1b158f5700 -1 osd.2 7 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-13T17:05:25.504 INFO:tasks.ceph.c2.osd.0.gibba038.stderr:2021-02-13 17:05:25.498 7f377ff53700 -1 osd.0 7 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-13T17:05:25.504 INFO:tasks.ceph.c2.osd.1.gibba038.stderr:2021-02-13 17:05:25.498 7ff7f61fb700 -1 osd.1 7 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-13T17:05:29.427 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2021-02-13T17:05:29.581 INFO:teuthology.misc.health.gibba038.stdout: 2021-02-13T17:05:29.581 INFO:teuthology.misc.health.gibba038.stdout:{"epoch":8,"fsid":"9862e2e1-3629-4a37-b410-fe5ad22a1229","created":"2021-02-13 17:05:21.399671","modified":"2021-02-13 17:05:26.487426","last_up_change":"2021-02-13 17:05:26.487426","last_in_change":"2021-02-13 17:05:26.487426","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"071ed5f1-52ee-49d1-8385-810f302f85a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6800","nonce":14244},{"type":"v1","addr":"172.21.2.138:6801","nonce":14244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6802","nonce":14244},{"type":"v1","addr":"172.21.2.138:6803","nonce":14244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6808","nonce":14244},{"type":"v1","addr":"172.21.2.138:6810","nonce":14244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6804","nonce":14244},{"type":"v1","addr":"172.21.2.138:6806","nonce":14244}]},"public_addr":"172.21.2.138:6801/14244","cluster_addr":"172.21.2.138:6803/14244","heartbeat_back_addr":"172.21.2.138:6810/14244","heartbeat_front_addr":"172.21.2.138:6806/14244","state":["exists","up"]},{"osd":1,"uuid":"2842cc8e-04a5-415b-9635-a8fa91816c5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6816","nonce":14245},{"type":"v1","addr":"172.21.2.138:6817","nonce":14245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6818","nonce":14245},{"type":"v1","addr":"172.21.2.138:6819","nonce":14245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6822","nonce":14245},{"type":"v1","addr":"172.21.2.138:6823","nonce":14245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6820","nonce":14245},{"type":"v1","addr":"172.21.2.138:6821","nonce":14245}]},"public_addr":"172.21.2.138:6817/14245","cluster_addr":"172.21.2.138:6819/14245","heartbeat_back_addr":"172.21.2.138:6823/14245","heartbeat_front_addr":"172.21.2.138:6821/14245","state":["exists","up"]},{"osd":2,"uuid":"ee3f40ad-6deb-45ad-8034-b96f1d263346","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6805","nonce":14246},{"type":"v1","addr":"172.21.2.138:6807","nonce":14246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6809","nonce":14246},{"type":"v1","addr":"172.21.2.138:6811","nonce":14246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6814","nonce":14246},{"type":"v1","addr":"172.21.2.138:6815","nonce":14246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6812","nonce":14246},{"type":"v1","addr":"172.21.2.138:6813","nonce":14246}]},"public_addr":"172.21.2.138:6807/14246","cluster_addr":"172.21.2.138:6811/14246","heartbeat_back_addr":"172.21.2.138:6815/14246","heartbeat_front_addr":"172.21.2.138:6813/14246","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T17:05:29.589 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-02-13T17:05:29.589 INFO:tasks.ceph:Creating RBD pool 2021-02-13T17:05:29.589 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --cluster c2 osd pool create rbd 8 2021-02-13T17:05:30.557 INFO:teuthology.orchestra.run.gibba038.stderr:pool 'rbd' created 2021-02-13T17:05:30.588 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --cluster c2 osd pool application enable rbd rbd --yes-i-really-mean-it 2021-02-13T17:05:31.566 INFO:teuthology.orchestra.run.gibba038.stderr:enabled application 'rbd' on pool 'rbd' 2021-02-13T17:05:31.575 INFO:tasks.ceph:Starting mds daemons in cluster c2... 2021-02-13T17:05:31.576 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 osd dump --format=json 2021-02-13T17:05:31.731 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:31.731 INFO:teuthology.orchestra.run.gibba038.stdout:{"epoch":10,"fsid":"9862e2e1-3629-4a37-b410-fe5ad22a1229","created":"2021-02-13 17:05:21.399671","modified":"2021-02-13 17:05:31.539895","last_up_change":"2021-02-13 17:05:26.487426","last_in_change":"2021-02-13 17:05:26.487426","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-13 17:05:29.735450","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"071ed5f1-52ee-49d1-8385-810f302f85a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6800","nonce":14244},{"type":"v1","addr":"172.21.2.138:6801","nonce":14244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6802","nonce":14244},{"type":"v1","addr":"172.21.2.138:6803","nonce":14244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6808","nonce":14244},{"type":"v1","addr":"172.21.2.138:6810","nonce":14244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6804","nonce":14244},{"type":"v1","addr":"172.21.2.138:6806","nonce":14244}]},"public_addr":"172.21.2.138:6801/14244","cluster_addr":"172.21.2.138:6803/14244","heartbeat_back_addr":"172.21.2.138:6810/14244","heartbeat_front_addr":"172.21.2.138:6806/14244","state":["exists","up"]},{"osd":1,"uuid":"2842cc8e-04a5-415b-9635-a8fa91816c5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6816","nonce":14245},{"type":"v1","addr":"172.21.2.138:6817","nonce":14245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6818","nonce":14245},{"type":"v1","addr":"172.21.2.138:6819","nonce":14245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6822","nonce":14245},{"type":"v1","addr":"172.21.2.138:6823","nonce":14245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6820","nonce":14245},{"type":"v1","addr":"172.21.2.138:6821","nonce":14245}]},"public_addr":"172.21.2.138:6817/14245","cluster_addr":"172.21.2.138:6819/14245","heartbeat_back_addr":"172.21.2.138:6823/14245","heartbeat_front_addr":"172.21.2.138:6821/14245","state":["exists","up"]},{"osd":2,"uuid":"ee3f40ad-6deb-45ad-8034-b96f1d263346","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6805","nonce":14246},{"type":"v1","addr":"172.21.2.138:6807","nonce":14246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6809","nonce":14246},{"type":"v1","addr":"172.21.2.138:6811","nonce":14246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6814","nonce":14246},{"type":"v1","addr":"172.21.2.138:6815","nonce":14246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6812","nonce":14246},{"type":"v1","addr":"172.21.2.138:6813","nonce":14246}]},"public_addr":"172.21.2.138:6807/14246","cluster_addr":"172.21.2.138:6811/14246","heartbeat_back_addr":"172.21.2.138:6815/14246","heartbeat_front_addr":"172.21.2.138:6813/14246","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T17:05:31.739 INFO:tasks.ceph.ceph_manager.c2:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-02-13 17:05:29.735450', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-13T17:05:31.739 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 osd pool get rbd pg_num 2021-02-13T17:05:31.890 INFO:teuthology.orchestra.run.gibba038.stdout:pg_num: 8 2021-02-13T17:05:31.899 INFO:tasks.ceph:Waiting until c2 daemons up and pgs clean... 2021-02-13T17:05:31.899 INFO:tasks.ceph.ceph_manager.c2:waiting for mgr available 2021-02-13T17:05:31.900 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 mgr dump --format=json 2021-02-13T17:05:32.080 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:32.087 INFO:teuthology.orchestra.run.gibba038.stdout:{"epoch":3,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6824","nonce":14022},{"type":"v1","addr":"172.21.2.138:6825","nonce":14022}]},"active_addr":"172.21.2.138:6825/14022","active_change":"2021-02-13 17:05:23.476237","available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout_min":{"name":"inventory_cache_timeout_min","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"]}} 2021-02-13T17:05:32.088 INFO:tasks.ceph.ceph_manager.c2:mgr available! 2021-02-13T17:05:32.392 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2021-02-13T17:05:32.551 INFO:teuthology.misc.health.gibba038.stdout: 2021-02-13T17:05:32.551 INFO:teuthology.misc.health.gibba038.stdout:{"epoch":11,"fsid":"9862e2e1-3629-4a37-b410-fe5ad22a1229","created":"2021-02-13 17:05:21.399671","modified":"2021-02-13 17:05:32.544765","last_up_change":"2021-02-13 17:05:26.487426","last_in_change":"2021-02-13 17:05:26.487426","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-13 17:05:29.735450","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"071ed5f1-52ee-49d1-8385-810f302f85a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6800","nonce":14244},{"type":"v1","addr":"172.21.2.138:6801","nonce":14244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6802","nonce":14244},{"type":"v1","addr":"172.21.2.138:6803","nonce":14244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6808","nonce":14244},{"type":"v1","addr":"172.21.2.138:6810","nonce":14244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6804","nonce":14244},{"type":"v1","addr":"172.21.2.138:6806","nonce":14244}]},"public_addr":"172.21.2.138:6801/14244","cluster_addr":"172.21.2.138:6803/14244","heartbeat_back_addr":"172.21.2.138:6810/14244","heartbeat_front_addr":"172.21.2.138:6806/14244","state":["exists","up"]},{"osd":1,"uuid":"2842cc8e-04a5-415b-9635-a8fa91816c5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6816","nonce":14245},{"type":"v1","addr":"172.21.2.138:6817","nonce":14245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6818","nonce":14245},{"type":"v1","addr":"172.21.2.138:6819","nonce":14245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6822","nonce":14245},{"type":"v1","addr":"172.21.2.138:6823","nonce":14245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6820","nonce":14245},{"type":"v1","addr":"172.21.2.138:6821","nonce":14245}]},"public_addr":"172.21.2.138:6817/14245","cluster_addr":"172.21.2.138:6819/14245","heartbeat_back_addr":"172.21.2.138:6823/14245","heartbeat_front_addr":"172.21.2.138:6821/14245","state":["exists","up"]},{"osd":2,"uuid":"ee3f40ad-6deb-45ad-8034-b96f1d263346","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6805","nonce":14246},{"type":"v1","addr":"172.21.2.138:6807","nonce":14246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6809","nonce":14246},{"type":"v1","addr":"172.21.2.138:6811","nonce":14246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6814","nonce":14246},{"type":"v1","addr":"172.21.2.138:6815","nonce":14246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6812","nonce":14246},{"type":"v1","addr":"172.21.2.138:6813","nonce":14246}]},"public_addr":"172.21.2.138:6807/14246","cluster_addr":"172.21.2.138:6811/14246","heartbeat_back_addr":"172.21.2.138:6815/14246","heartbeat_front_addr":"172.21.2.138:6813/14246","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T17:05:32.559 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-02-13T17:05:32.560 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 osd dump --format=json 2021-02-13T17:05:32.709 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:32.709 INFO:teuthology.orchestra.run.gibba038.stdout:{"epoch":11,"fsid":"9862e2e1-3629-4a37-b410-fe5ad22a1229","created":"2021-02-13 17:05:21.399671","modified":"2021-02-13 17:05:32.544765","last_up_change":"2021-02-13 17:05:26.487426","last_in_change":"2021-02-13 17:05:26.487426","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-13 17:05:29.735450","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"071ed5f1-52ee-49d1-8385-810f302f85a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6800","nonce":14244},{"type":"v1","addr":"172.21.2.138:6801","nonce":14244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6802","nonce":14244},{"type":"v1","addr":"172.21.2.138:6803","nonce":14244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6808","nonce":14244},{"type":"v1","addr":"172.21.2.138:6810","nonce":14244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6804","nonce":14244},{"type":"v1","addr":"172.21.2.138:6806","nonce":14244}]},"public_addr":"172.21.2.138:6801/14244","cluster_addr":"172.21.2.138:6803/14244","heartbeat_back_addr":"172.21.2.138:6810/14244","heartbeat_front_addr":"172.21.2.138:6806/14244","state":["exists","up"]},{"osd":1,"uuid":"2842cc8e-04a5-415b-9635-a8fa91816c5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6816","nonce":14245},{"type":"v1","addr":"172.21.2.138:6817","nonce":14245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6818","nonce":14245},{"type":"v1","addr":"172.21.2.138:6819","nonce":14245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6822","nonce":14245},{"type":"v1","addr":"172.21.2.138:6823","nonce":14245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6820","nonce":14245},{"type":"v1","addr":"172.21.2.138:6821","nonce":14245}]},"public_addr":"172.21.2.138:6817/14245","cluster_addr":"172.21.2.138:6819/14245","heartbeat_back_addr":"172.21.2.138:6823/14245","heartbeat_front_addr":"172.21.2.138:6821/14245","state":["exists","up"]},{"osd":2,"uuid":"ee3f40ad-6deb-45ad-8034-b96f1d263346","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6805","nonce":14246},{"type":"v1","addr":"172.21.2.138:6807","nonce":14246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6809","nonce":14246},{"type":"v1","addr":"172.21.2.138:6811","nonce":14246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6814","nonce":14246},{"type":"v1","addr":"172.21.2.138:6815","nonce":14246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6812","nonce":14246},{"type":"v1","addr":"172.21.2.138:6813","nonce":14246}]},"public_addr":"172.21.2.138:6807/14246","cluster_addr":"172.21.2.138:6811/14246","heartbeat_back_addr":"172.21.2.138:6815/14246","heartbeat_front_addr":"172.21.2.138:6813/14246","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T17:05:32.717 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 tell osd.0 flush_pg_stats 2021-02-13T17:05:32.774 INFO:teuthology.orchestra.run.gibba038.stdout:34359738371 2021-02-13T17:05:32.782 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 tell osd.1 flush_pg_stats 2021-02-13T17:05:32.845 INFO:teuthology.orchestra.run.gibba038.stdout:34359738372 2021-02-13T17:05:32.853 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 tell osd.2 flush_pg_stats 2021-02-13T17:05:32.914 INFO:teuthology.orchestra.run.gibba038.stdout:34359738372 2021-02-13T17:05:32.921 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 osd last-stat-seq osd.0 2021-02-13T17:05:33.092 INFO:teuthology.orchestra.run.gibba038.stdout:34359738369 2021-02-13T17:05:33.101 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738371 got 34359738369 for osd.0 2021-02-13T17:05:34.102 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 osd last-stat-seq osd.0 2021-02-13T17:05:34.270 INFO:teuthology.orchestra.run.gibba038.stdout:34359738371 2021-02-13T17:05:34.278 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738371 got 34359738371 for osd.0 2021-02-13T17:05:34.279 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 osd last-stat-seq osd.1 2021-02-13T17:05:34.443 INFO:teuthology.orchestra.run.gibba038.stdout:34359738372 2021-02-13T17:05:34.452 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738372 got 34359738372 for osd.1 2021-02-13T17:05:34.452 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 osd last-stat-seq osd.2 2021-02-13T17:05:34.613 INFO:teuthology.orchestra.run.gibba038.stdout:34359738372 2021-02-13T17:05:34.621 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738372 got 34359738372 for osd.2 2021-02-13T17:05:34.622 INFO:tasks.ceph.ceph_manager.c2:waiting for clean 2021-02-13T17:05:34.622 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 pg dump --format=json 2021-02-13T17:05:34.778 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:34.778 INFO:teuthology.orchestra.run.gibba038.stderr:dumped all 2021-02-13T17:05:34.785 INFO:teuthology.orchestra.run.gibba038.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2021-02-13 17:05:33.481277","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":3,"num_per_pool_osds":3,"kb":314572800,"kb_used":3146016,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426784,"statfs":{"total":322122547200,"available":318901026816,"internally_reserved":3221225472,"allocated":270336,"data_stored":62295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:31.556333","last_change":"2021-02-13 17:05:31.555912","last_active":"2021-02-13 17:05:31.556333","last_peered":"2021-02-13 17:05:31.556333","last_clean":"2021-02-13 17:05:31.556333","last_became_active":"2021-02-13 17:05:31.555654","last_became_peered":"2021-02-13 17:05:31.555654","last_unstale":"2021-02-13 17:05:31.556333","last_undegraded":"2021-02-13 17:05:31.556333","last_fullsized":"2021-02-13 17:05:31.556333","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:30.533556","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:30.533556","last_clean_scrub_stamp":"2021-02-13 17:05:30.533556","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:31.556720","last_change":"2021-02-13 17:05:31.556300","last_active":"2021-02-13 17:05:31.556720","last_peered":"2021-02-13 17:05:31.556720","last_clean":"2021-02-13 17:05:31.556720","last_became_active":"2021-02-13 17:05:31.556082","last_became_peered":"2021-02-13 17:05:31.556082","last_unstale":"2021-02-13 17:05:31.556720","last_undegraded":"2021-02-13 17:05:31.556720","last_fullsized":"2021-02-13 17:05:31.556720","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:30.533556","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:30.533556","last_clean_scrub_stamp":"2021-02-13 17:05:30.533556","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:31.555818","last_change":"2021-02-13 17:05:31.555818","last_active":"2021-02-13 17:05:31.555818","last_peered":"2021-02-13 17:05:31.555818","last_clean":"2021-02-13 17:05:31.555818","last_became_active":"2021-02-13 17:05:31.555586","last_became_peered":"2021-02-13 17:05:31.555586","last_unstale":"2021-02-13 17:05:31.555818","last_undegraded":"2021-02-13 17:05:31.555818","last_fullsized":"2021-02-13 17:05:31.555818","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:30.533556","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:30.533556","last_clean_scrub_stamp":"2021-02-13 17:05:30.533556","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:31.556718","last_change":"2021-02-13 17:05:31.556436","last_active":"2021-02-13 17:05:31.556718","last_peered":"2021-02-13 17:05:31.556718","last_clean":"2021-02-13 17:05:31.556718","last_became_active":"2021-02-13 17:05:31.556234","last_became_peered":"2021-02-13 17:05:31.556234","last_unstale":"2021-02-13 17:05:31.556718","last_undegraded":"2021-02-13 17:05:31.556718","last_fullsized":"2021-02-13 17:05:31.556718","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:30.533556","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:30.533556","last_clean_scrub_stamp":"2021-02-13 17:05:30.533556","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:31.555318","last_change":"2021-02-13 17:05:31.555318","last_active":"2021-02-13 17:05:31.555318","last_peered":"2021-02-13 17:05:31.555318","last_clean":"2021-02-13 17:05:31.555318","last_became_active":"2021-02-13 17:05:31.555092","last_became_peered":"2021-02-13 17:05:31.555092","last_unstale":"2021-02-13 17:05:31.555318","last_undegraded":"2021-02-13 17:05:31.555318","last_fullsized":"2021-02-13 17:05:31.555318","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:30.533556","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:30.533556","last_clean_scrub_stamp":"2021-02-13 17:05:30.533556","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:31.556339","last_change":"2021-02-13 17:05:31.555900","last_active":"2021-02-13 17:05:31.556339","last_peered":"2021-02-13 17:05:31.556339","last_clean":"2021-02-13 17:05:31.556339","last_became_active":"2021-02-13 17:05:31.555627","last_became_peered":"2021-02-13 17:05:31.555627","last_unstale":"2021-02-13 17:05:31.556339","last_undegraded":"2021-02-13 17:05:31.556339","last_fullsized":"2021-02-13 17:05:31.556339","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:30.533556","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:30.533556","last_clean_scrub_stamp":"2021-02-13 17:05:30.533556","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:31.556064","last_change":"2021-02-13 17:05:31.555698","last_active":"2021-02-13 17:05:31.556064","last_peered":"2021-02-13 17:05:31.556064","last_clean":"2021-02-13 17:05:31.556064","last_became_active":"2021-02-13 17:05:31.555458","last_became_peered":"2021-02-13 17:05:31.555458","last_unstale":"2021-02-13 17:05:31.556064","last_undegraded":"2021-02-13 17:05:31.556064","last_fullsized":"2021-02-13 17:05:31.556064","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:30.533556","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:30.533556","last_clean_scrub_stamp":"2021-02-13 17:05:30.533556","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:31.556002","last_change":"2021-02-13 17:05:31.556002","last_active":"2021-02-13 17:05:31.556002","last_peered":"2021-02-13 17:05:31.556002","last_clean":"2021-02-13 17:05:31.556002","last_became_active":"2021-02-13 17:05:31.555834","last_became_peered":"2021-02-13 17:05:31.555834","last_unstale":"2021-02-13 17:05:31.556002","last_undegraded":"2021-02-13 17:05:31.556002","last_fullsized":"2021-02-13 17:05:31.556002","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:30.533556","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:30.533556","last_clean_scrub_stamp":"2021-02-13 17:05:30.533556","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048672,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808928,"statfs":{"total":107374182400,"available":106300342272,"internally_reserved":1073741824,"allocated":90112,"data_stored":20765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.077}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048672,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808928,"statfs":{"total":107374182400,"available":106300342272,"internally_reserved":1073741824,"allocated":90112,"data_stored":20765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.601}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048672,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808928,"statfs":{"total":107374182400,"available":106300342272,"internally_reserved":1073741824,"allocated":90112,"data_stored":20765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8640000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4169999999999998}]}]}]}} 2021-02-13T17:05:34.786 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 pg dump --format=json 2021-02-13T17:05:34.939 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:34.940 INFO:teuthology.orchestra.run.gibba038.stderr:dumped all 2021-02-13T17:05:34.947 INFO:teuthology.orchestra.run.gibba038.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2021-02-13 17:05:33.481277","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":3,"num_per_pool_osds":3,"kb":314572800,"kb_used":3146016,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426784,"statfs":{"total":322122547200,"available":318901026816,"internally_reserved":3221225472,"allocated":270336,"data_stored":62295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:31.556333","last_change":"2021-02-13 17:05:31.555912","last_active":"2021-02-13 17:05:31.556333","last_peered":"2021-02-13 17:05:31.556333","last_clean":"2021-02-13 17:05:31.556333","last_became_active":"2021-02-13 17:05:31.555654","last_became_peered":"2021-02-13 17:05:31.555654","last_unstale":"2021-02-13 17:05:31.556333","last_undegraded":"2021-02-13 17:05:31.556333","last_fullsized":"2021-02-13 17:05:31.556333","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:30.533556","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:30.533556","last_clean_scrub_stamp":"2021-02-13 17:05:30.533556","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:31.556720","last_change":"2021-02-13 17:05:31.556300","last_active":"2021-02-13 17:05:31.556720","last_peered":"2021-02-13 17:05:31.556720","last_clean":"2021-02-13 17:05:31.556720","last_became_active":"2021-02-13 17:05:31.556082","last_became_peered":"2021-02-13 17:05:31.556082","last_unstale":"2021-02-13 17:05:31.556720","last_undegraded":"2021-02-13 17:05:31.556720","last_fullsized":"2021-02-13 17:05:31.556720","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:30.533556","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:30.533556","last_clean_scrub_stamp":"2021-02-13 17:05:30.533556","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:31.555818","last_change":"2021-02-13 17:05:31.555818","last_active":"2021-02-13 17:05:31.555818","last_peered":"2021-02-13 17:05:31.555818","last_clean":"2021-02-13 17:05:31.555818","last_became_active":"2021-02-13 17:05:31.555586","last_became_peered":"2021-02-13 17:05:31.555586","last_unstale":"2021-02-13 17:05:31.555818","last_undegraded":"2021-02-13 17:05:31.555818","last_fullsized":"2021-02-13 17:05:31.555818","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:30.533556","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:30.533556","last_clean_scrub_stamp":"2021-02-13 17:05:30.533556","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:31.556718","last_change":"2021-02-13 17:05:31.556436","last_active":"2021-02-13 17:05:31.556718","last_peered":"2021-02-13 17:05:31.556718","last_clean":"2021-02-13 17:05:31.556718","last_became_active":"2021-02-13 17:05:31.556234","last_became_peered":"2021-02-13 17:05:31.556234","last_unstale":"2021-02-13 17:05:31.556718","last_undegraded":"2021-02-13 17:05:31.556718","last_fullsized":"2021-02-13 17:05:31.556718","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:30.533556","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:30.533556","last_clean_scrub_stamp":"2021-02-13 17:05:30.533556","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:31.555318","last_change":"2021-02-13 17:05:31.555318","last_active":"2021-02-13 17:05:31.555318","last_peered":"2021-02-13 17:05:31.555318","last_clean":"2021-02-13 17:05:31.555318","last_became_active":"2021-02-13 17:05:31.555092","last_became_peered":"2021-02-13 17:05:31.555092","last_unstale":"2021-02-13 17:05:31.555318","last_undegraded":"2021-02-13 17:05:31.555318","last_fullsized":"2021-02-13 17:05:31.555318","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:30.533556","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:30.533556","last_clean_scrub_stamp":"2021-02-13 17:05:30.533556","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:31.556339","last_change":"2021-02-13 17:05:31.555900","last_active":"2021-02-13 17:05:31.556339","last_peered":"2021-02-13 17:05:31.556339","last_clean":"2021-02-13 17:05:31.556339","last_became_active":"2021-02-13 17:05:31.555627","last_became_peered":"2021-02-13 17:05:31.555627","last_unstale":"2021-02-13 17:05:31.556339","last_undegraded":"2021-02-13 17:05:31.556339","last_fullsized":"2021-02-13 17:05:31.556339","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:30.533556","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:30.533556","last_clean_scrub_stamp":"2021-02-13 17:05:30.533556","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:31.556064","last_change":"2021-02-13 17:05:31.555698","last_active":"2021-02-13 17:05:31.556064","last_peered":"2021-02-13 17:05:31.556064","last_clean":"2021-02-13 17:05:31.556064","last_became_active":"2021-02-13 17:05:31.555458","last_became_peered":"2021-02-13 17:05:31.555458","last_unstale":"2021-02-13 17:05:31.556064","last_undegraded":"2021-02-13 17:05:31.556064","last_fullsized":"2021-02-13 17:05:31.556064","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:30.533556","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:30.533556","last_clean_scrub_stamp":"2021-02-13 17:05:30.533556","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:05:31.556002","last_change":"2021-02-13 17:05:31.556002","last_active":"2021-02-13 17:05:31.556002","last_peered":"2021-02-13 17:05:31.556002","last_clean":"2021-02-13 17:05:31.556002","last_became_active":"2021-02-13 17:05:31.555834","last_became_peered":"2021-02-13 17:05:31.555834","last_unstale":"2021-02-13 17:05:31.556002","last_undegraded":"2021-02-13 17:05:31.556002","last_fullsized":"2021-02-13 17:05:31.556002","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:05:30.533556","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:05:30.533556","last_clean_scrub_stamp":"2021-02-13 17:05:30.533556","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048672,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808928,"statfs":{"total":107374182400,"available":106300342272,"internally_reserved":1073741824,"allocated":90112,"data_stored":20765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.077}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048672,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808928,"statfs":{"total":107374182400,"available":106300342272,"internally_reserved":1073741824,"allocated":90112,"data_stored":20765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.601}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048672,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808928,"statfs":{"total":107374182400,"available":106300342272,"internally_reserved":1073741824,"allocated":90112,"data_stored":20765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8640000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4169999999999998}]}]}]}} 2021-02-13T17:05:34.948 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 status --format=json-pretty 2021-02-13T17:05:35.105 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T17:05:35.105 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-02-13T17:05:35.105 INFO:teuthology.orchestra.run.gibba038.stdout: "fsid": "9862e2e1-3629-4a37-b410-fe5ad22a1229", 2021-02-13T17:05:35.106 INFO:teuthology.orchestra.run.gibba038.stdout: "health": { 2021-02-13T17:05:35.106 INFO:teuthology.orchestra.run.gibba038.stdout: "checks": {}, 2021-02-13T17:05:35.106 INFO:teuthology.orchestra.run.gibba038.stdout: "status": "HEALTH_OK" 2021-02-13T17:05:35.106 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.106 INFO:teuthology.orchestra.run.gibba038.stdout: "election_epoch": 3, 2021-02-13T17:05:35.106 INFO:teuthology.orchestra.run.gibba038.stdout: "quorum": [ 2021-02-13T17:05:35.106 INFO:teuthology.orchestra.run.gibba038.stdout: 0 2021-02-13T17:05:35.106 INFO:teuthology.orchestra.run.gibba038.stdout: ], 2021-02-13T17:05:35.106 INFO:teuthology.orchestra.run.gibba038.stdout: "quorum_names": [ 2021-02-13T17:05:35.106 INFO:teuthology.orchestra.run.gibba038.stdout: "a" 2021-02-13T17:05:35.106 INFO:teuthology.orchestra.run.gibba038.stdout: ], 2021-02-13T17:05:35.106 INFO:teuthology.orchestra.run.gibba038.stdout: "quorum_age": 13, 2021-02-13T17:05:35.106 INFO:teuthology.orchestra.run.gibba038.stdout: "monmap": { 2021-02-13T17:05:35.107 INFO:teuthology.orchestra.run.gibba038.stdout: "epoch": 1, 2021-02-13T17:05:35.107 INFO:teuthology.orchestra.run.gibba038.stdout: "min_mon_release_name": "14", 2021-02-13T17:05:35.107 INFO:teuthology.orchestra.run.gibba038.stdout: "num_mons": 1 2021-02-13T17:05:35.107 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.107 INFO:teuthology.orchestra.run.gibba038.stdout: "osdmap": { 2021-02-13T17:05:35.107 INFO:teuthology.orchestra.run.gibba038.stdout: "osdmap": { 2021-02-13T17:05:35.107 INFO:teuthology.orchestra.run.gibba038.stdout: "epoch": 11, 2021-02-13T17:05:35.107 INFO:teuthology.orchestra.run.gibba038.stdout: "num_osds": 3, 2021-02-13T17:05:35.107 INFO:teuthology.orchestra.run.gibba038.stdout: "num_up_osds": 3, 2021-02-13T17:05:35.107 INFO:teuthology.orchestra.run.gibba038.stdout: "num_in_osds": 3, 2021-02-13T17:05:35.107 INFO:teuthology.orchestra.run.gibba038.stdout: "num_remapped_pgs": 0 2021-02-13T17:05:35.107 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.107 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.108 INFO:teuthology.orchestra.run.gibba038.stdout: "pgmap": { 2021-02-13T17:05:35.108 INFO:teuthology.orchestra.run.gibba038.stdout: "pgs_by_state": [ 2021-02-13T17:05:35.108 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.108 INFO:teuthology.orchestra.run.gibba038.stdout: "state_name": "active+clean", 2021-02-13T17:05:35.108 INFO:teuthology.orchestra.run.gibba038.stdout: "count": 8 2021-02-13T17:05:35.108 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.108 INFO:teuthology.orchestra.run.gibba038.stdout: ], 2021-02-13T17:05:35.108 INFO:teuthology.orchestra.run.gibba038.stdout: "num_pgs": 8, 2021-02-13T17:05:35.108 INFO:teuthology.orchestra.run.gibba038.stdout: "num_pools": 1, 2021-02-13T17:05:35.108 INFO:teuthology.orchestra.run.gibba038.stdout: "num_objects": 0, 2021-02-13T17:05:35.108 INFO:teuthology.orchestra.run.gibba038.stdout: "data_bytes": 0, 2021-02-13T17:05:35.108 INFO:teuthology.orchestra.run.gibba038.stdout: "bytes_used": 3221520384, 2021-02-13T17:05:35.109 INFO:teuthology.orchestra.run.gibba038.stdout: "bytes_avail": 318901026816, 2021-02-13T17:05:35.109 INFO:teuthology.orchestra.run.gibba038.stdout: "bytes_total": 322122547200 2021-02-13T17:05:35.109 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.109 INFO:teuthology.orchestra.run.gibba038.stdout: "fsmap": { 2021-02-13T17:05:35.109 INFO:teuthology.orchestra.run.gibba038.stdout: "epoch": 1, 2021-02-13T17:05:35.109 INFO:teuthology.orchestra.run.gibba038.stdout: "by_rank": [], 2021-02-13T17:05:35.109 INFO:teuthology.orchestra.run.gibba038.stdout: "up:standby": 0 2021-02-13T17:05:35.109 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.109 INFO:teuthology.orchestra.run.gibba038.stdout: "mgrmap": { 2021-02-13T17:05:35.109 INFO:teuthology.orchestra.run.gibba038.stdout: "epoch": 3, 2021-02-13T17:05:35.109 INFO:teuthology.orchestra.run.gibba038.stdout: "active_gid": 4100, 2021-02-13T17:05:35.109 INFO:teuthology.orchestra.run.gibba038.stdout: "active_name": "x", 2021-02-13T17:05:35.109 INFO:teuthology.orchestra.run.gibba038.stdout: "active_addrs": { 2021-02-13T17:05:35.109 INFO:teuthology.orchestra.run.gibba038.stdout: "addrvec": [ 2021-02-13T17:05:35.110 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.110 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v2", 2021-02-13T17:05:35.110 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:6824", 2021-02-13T17:05:35.110 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 14022 2021-02-13T17:05:35.110 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.110 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.110 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-02-13T17:05:35.110 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:6825", 2021-02-13T17:05:35.110 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 14022 2021-02-13T17:05:35.110 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.110 INFO:teuthology.orchestra.run.gibba038.stdout: ] 2021-02-13T17:05:35.110 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.111 INFO:teuthology.orchestra.run.gibba038.stdout: "active_addr": "172.21.2.138:6825/14022", 2021-02-13T17:05:35.111 INFO:teuthology.orchestra.run.gibba038.stdout: "active_change": "2021-02-13 17:05:23.476237", 2021-02-13T17:05:35.111 INFO:teuthology.orchestra.run.gibba038.stdout: "available": true, 2021-02-13T17:05:35.111 INFO:teuthology.orchestra.run.gibba038.stdout: "standbys": [], 2021-02-13T17:05:35.111 INFO:teuthology.orchestra.run.gibba038.stdout: "modules": [ 2021-02-13T17:05:35.111 INFO:teuthology.orchestra.run.gibba038.stdout: "iostat", 2021-02-13T17:05:35.111 INFO:teuthology.orchestra.run.gibba038.stdout: "restful" 2021-02-13T17:05:35.111 INFO:teuthology.orchestra.run.gibba038.stdout: ], 2021-02-13T17:05:35.111 INFO:teuthology.orchestra.run.gibba038.stdout: "available_modules": [ 2021-02-13T17:05:35.111 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.111 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "alerts", 2021-02-13T17:05:35.111 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.111 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.112 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.112 INFO:teuthology.orchestra.run.gibba038.stdout: "interval": { 2021-02-13T17:05:35.112 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "interval", 2021-02-13T17:05:35.112 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "secs", 2021-02-13T17:05:35.112 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.112 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.112 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "60", 2021-02-13T17:05:35.112 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.112 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.112 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.112 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "How frequently to reexamine health status", 2021-02-13T17:05:35.112 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.112 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.112 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.113 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.113 INFO:teuthology.orchestra.run.gibba038.stdout: "smtp_destination": { 2021-02-13T17:05:35.113 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "smtp_destination", 2021-02-13T17:05:35.113 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.113 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.113 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.113 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.113 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.113 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.113 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.113 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "Email address to send alerts to", 2021-02-13T17:05:35.113 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.113 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.113 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.114 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.114 INFO:teuthology.orchestra.run.gibba038.stdout: "smtp_from_name": { 2021-02-13T17:05:35.114 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "smtp_from_name", 2021-02-13T17:05:35.114 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.114 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.114 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.114 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "Ceph", 2021-02-13T17:05:35.114 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.114 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.114 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.114 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "Email From: name", 2021-02-13T17:05:35.114 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.114 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.115 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.115 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.115 INFO:teuthology.orchestra.run.gibba038.stdout: "smtp_host": { 2021-02-13T17:05:35.115 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "smtp_host", 2021-02-13T17:05:35.115 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.115 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.115 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.115 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.115 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.115 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.115 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.115 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "SMTP server", 2021-02-13T17:05:35.115 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.116 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.116 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.116 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.116 INFO:teuthology.orchestra.run.gibba038.stdout: "smtp_password": { 2021-02-13T17:05:35.116 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "smtp_password", 2021-02-13T17:05:35.116 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.116 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.116 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.116 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.116 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.116 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.116 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.116 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "Password to authenticate with", 2021-02-13T17:05:35.117 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.117 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.117 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.117 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.117 INFO:teuthology.orchestra.run.gibba038.stdout: "smtp_port": { 2021-02-13T17:05:35.117 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "smtp_port", 2021-02-13T17:05:35.117 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "int", 2021-02-13T17:05:35.117 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.117 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.117 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "465", 2021-02-13T17:05:35.117 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.117 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.117 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.117 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "SMTP port", 2021-02-13T17:05:35.118 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.118 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.118 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.118 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.118 INFO:teuthology.orchestra.run.gibba038.stdout: "smtp_sender": { 2021-02-13T17:05:35.118 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "smtp_sender", 2021-02-13T17:05:35.118 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.118 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.118 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.118 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.118 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.118 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.119 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.119 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "SMTP envelope sender", 2021-02-13T17:05:35.119 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.119 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.119 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.119 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.119 INFO:teuthology.orchestra.run.gibba038.stdout: "smtp_ssl": { 2021-02-13T17:05:35.119 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "smtp_ssl", 2021-02-13T17:05:35.119 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.119 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.119 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.119 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "True", 2021-02-13T17:05:35.119 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.120 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.120 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.120 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "Use SSL to connect to SMTP server", 2021-02-13T17:05:35.120 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.120 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.120 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.120 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.120 INFO:teuthology.orchestra.run.gibba038.stdout: "smtp_user": { 2021-02-13T17:05:35.120 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "smtp_user", 2021-02-13T17:05:35.120 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.120 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.120 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.120 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.120 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.121 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.121 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.121 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "User to authenticate as", 2021-02-13T17:05:35.121 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.121 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.121 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.121 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.121 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.121 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.121 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.121 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "ansible", 2021-02-13T17:05:35.121 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.121 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.122 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.122 INFO:teuthology.orchestra.run.gibba038.stdout: "password": { 2021-02-13T17:05:35.122 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "password", 2021-02-13T17:05:35.122 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.122 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.122 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.122 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.122 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.122 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.122 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.122 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.122 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.122 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.123 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.123 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.123 INFO:teuthology.orchestra.run.gibba038.stdout: "server_url": { 2021-02-13T17:05:35.123 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "server_url", 2021-02-13T17:05:35.123 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.123 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.123 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.123 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.123 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.123 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.123 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.123 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.124 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.124 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.124 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.124 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.124 INFO:teuthology.orchestra.run.gibba038.stdout: "username": { 2021-02-13T17:05:35.124 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "username", 2021-02-13T17:05:35.124 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.124 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.124 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.124 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.124 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.125 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.125 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.125 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.125 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.125 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.125 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.125 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.125 INFO:teuthology.orchestra.run.gibba038.stdout: "verify_server": { 2021-02-13T17:05:35.125 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "verify_server", 2021-02-13T17:05:35.125 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.125 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.125 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.126 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.126 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.126 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.126 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.126 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.126 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.126 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.126 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.126 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.126 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.126 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.126 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.127 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "balancer", 2021-02-13T17:05:35.127 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.127 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.127 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.127 INFO:teuthology.orchestra.run.gibba038.stdout: "active": { 2021-02-13T17:05:35.127 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "active", 2021-02-13T17:05:35.127 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.127 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.127 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.127 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "False", 2021-02-13T17:05:35.127 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.127 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.128 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.128 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "automatically balance PGs across cluster", 2021-02-13T17:05:35.128 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.128 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.128 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.128 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.128 INFO:teuthology.orchestra.run.gibba038.stdout: "begin_time": { 2021-02-13T17:05:35.128 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "begin_time", 2021-02-13T17:05:35.128 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.128 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.128 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.128 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "0000", 2021-02-13T17:05:35.128 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.129 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.129 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.129 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "beginning time of day to automatically balance", 2021-02-13T17:05:35.129 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-02-13T17:05:35.129 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.129 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.129 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.129 INFO:teuthology.orchestra.run.gibba038.stdout: "begin_weekday": { 2021-02-13T17:05:35.129 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "begin_weekday", 2021-02-13T17:05:35.129 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "uint", 2021-02-13T17:05:35.129 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.129 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.129 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "0", 2021-02-13T17:05:35.129 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "0", 2021-02-13T17:05:35.130 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "7", 2021-02-13T17:05:35.130 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.130 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2021-02-13T17:05:35.130 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-02-13T17:05:35.130 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.130 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.130 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.130 INFO:teuthology.orchestra.run.gibba038.stdout: "crush_compat_max_iterations": { 2021-02-13T17:05:35.130 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "crush_compat_max_iterations", 2021-02-13T17:05:35.130 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "uint", 2021-02-13T17:05:35.130 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.130 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.131 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "25", 2021-02-13T17:05:35.131 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "1", 2021-02-13T17:05:35.131 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "250", 2021-02-13T17:05:35.131 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.131 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "maximum number of iterations to attempt optimization", 2021-02-13T17:05:35.131 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.131 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.131 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.131 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.131 INFO:teuthology.orchestra.run.gibba038.stdout: "crush_compat_metrics": { 2021-02-13T17:05:35.131 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "crush_compat_metrics", 2021-02-13T17:05:35.131 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.131 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.132 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.132 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "pgs,objects,bytes", 2021-02-13T17:05:35.132 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.132 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.132 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.132 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "metrics with which to calculate OSD utilization", 2021-02-13T17:05:35.132 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-02-13T17:05:35.132 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.132 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.132 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.132 INFO:teuthology.orchestra.run.gibba038.stdout: "crush_compat_step": { 2021-02-13T17:05:35.132 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "crush_compat_step", 2021-02-13T17:05:35.132 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "float", 2021-02-13T17:05:35.132 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.133 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.133 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "0.5", 2021-02-13T17:05:35.133 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "0.001", 2021-02-13T17:05:35.133 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "0.999", 2021-02-13T17:05:35.133 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.133 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "aggressiveness of optimization", 2021-02-13T17:05:35.133 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-02-13T17:05:35.133 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.133 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.133 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.133 INFO:teuthology.orchestra.run.gibba038.stdout: "end_time": { 2021-02-13T17:05:35.133 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "end_time", 2021-02-13T17:05:35.133 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.134 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.134 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.134 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "2400", 2021-02-13T17:05:35.134 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.134 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.134 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.134 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "ending time of day to automatically balance", 2021-02-13T17:05:35.134 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-02-13T17:05:35.134 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.134 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.134 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.134 INFO:teuthology.orchestra.run.gibba038.stdout: "end_weekday": { 2021-02-13T17:05:35.135 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "end_weekday", 2021-02-13T17:05:35.135 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "uint", 2021-02-13T17:05:35.135 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.135 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.135 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "7", 2021-02-13T17:05:35.135 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "0", 2021-02-13T17:05:35.135 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "7", 2021-02-13T17:05:35.135 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.135 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-02-13T17:05:35.135 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-02-13T17:05:35.135 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.135 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.136 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.136 INFO:teuthology.orchestra.run.gibba038.stdout: "min_score": { 2021-02-13T17:05:35.136 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "min_score", 2021-02-13T17:05:35.136 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "float", 2021-02-13T17:05:35.136 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.136 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.136 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "0", 2021-02-13T17:05:35.136 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.136 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.136 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.136 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "minimum score, below which no optimization is attempted", 2021-02-13T17:05:35.136 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.137 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.137 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.137 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.137 INFO:teuthology.orchestra.run.gibba038.stdout: "mode": { 2021-02-13T17:05:35.137 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "mode", 2021-02-13T17:05:35.137 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.137 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.137 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.137 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "none", 2021-02-13T17:05:35.137 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.137 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.137 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [ 2021-02-13T17:05:35.138 INFO:teuthology.orchestra.run.gibba038.stdout: "crush-compat", 2021-02-13T17:05:35.138 INFO:teuthology.orchestra.run.gibba038.stdout: "none", 2021-02-13T17:05:35.138 INFO:teuthology.orchestra.run.gibba038.stdout: "upmap" 2021-02-13T17:05:35.138 INFO:teuthology.orchestra.run.gibba038.stdout: ], 2021-02-13T17:05:35.138 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "Balancer mode", 2021-02-13T17:05:35.138 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.138 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.138 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.138 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.138 INFO:teuthology.orchestra.run.gibba038.stdout: "pool_ids": { 2021-02-13T17:05:35.138 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "pool_ids", 2021-02-13T17:05:35.138 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.138 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.139 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.139 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.139 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.139 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.139 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.139 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "pools which the automatic balancing will be limited to", 2021-02-13T17:05:35.139 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.139 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.139 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.139 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.139 INFO:teuthology.orchestra.run.gibba038.stdout: "sleep_interval": { 2021-02-13T17:05:35.139 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "sleep_interval", 2021-02-13T17:05:35.139 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "secs", 2021-02-13T17:05:35.140 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.140 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.140 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "60", 2021-02-13T17:05:35.140 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.140 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.140 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.140 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "how frequently to wake up and attempt optimization", 2021-02-13T17:05:35.140 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.140 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.140 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.140 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.140 INFO:teuthology.orchestra.run.gibba038.stdout: "upmap_max_deviation": { 2021-02-13T17:05:35.140 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "upmap_max_deviation", 2021-02-13T17:05:35.141 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "int", 2021-02-13T17:05:35.141 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.141 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.141 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "5", 2021-02-13T17:05:35.141 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "1", 2021-02-13T17:05:35.141 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.141 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.141 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "deviation below which no optimization is attempted", 2021-02-13T17:05:35.141 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-02-13T17:05:35.141 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.141 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.141 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.141 INFO:teuthology.orchestra.run.gibba038.stdout: "upmap_max_iterations": { 2021-02-13T17:05:35.142 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "upmap_max_iterations", 2021-02-13T17:05:35.142 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "uint", 2021-02-13T17:05:35.142 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.142 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.142 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "10", 2021-02-13T17:05:35.142 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.142 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.142 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.142 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "maximum upmap optimization iterations", 2021-02-13T17:05:35.142 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.142 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.142 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.142 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.143 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.143 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.143 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.143 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "crash", 2021-02-13T17:05:35.143 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.143 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.143 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.143 INFO:teuthology.orchestra.run.gibba038.stdout: "retain_interval": { 2021-02-13T17:05:35.143 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "retain_interval", 2021-02-13T17:05:35.143 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "secs", 2021-02-13T17:05:35.143 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.143 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.144 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "31536000", 2021-02-13T17:05:35.144 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.144 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.144 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.144 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "how long to retain crashes before pruning them", 2021-02-13T17:05:35.144 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.144 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.144 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.144 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.144 INFO:teuthology.orchestra.run.gibba038.stdout: "warn_recent_interval": { 2021-02-13T17:05:35.144 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "warn_recent_interval", 2021-02-13T17:05:35.144 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "secs", 2021-02-13T17:05:35.144 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.145 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.145 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "1209600", 2021-02-13T17:05:35.145 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.145 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.145 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.145 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "time interval in which to warn about recent crashes", 2021-02-13T17:05:35.145 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.145 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.145 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.145 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.145 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.145 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.145 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.145 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "dashboard", 2021-02-13T17:05:35.146 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.146 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.146 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.146 INFO:teuthology.orchestra.run.gibba038.stdout: "ALERTMANAGER_API_HOST": { 2021-02-13T17:05:35.146 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "ALERTMANAGER_API_HOST", 2021-02-13T17:05:35.146 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.146 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.146 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.146 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.146 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.146 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.146 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.147 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.147 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.147 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.147 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.147 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.147 INFO:teuthology.orchestra.run.gibba038.stdout: "AUDIT_API_ENABLED": { 2021-02-13T17:05:35.147 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "AUDIT_API_ENABLED", 2021-02-13T17:05:35.147 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.147 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.147 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.147 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "False", 2021-02-13T17:05:35.147 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.147 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.148 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.148 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.148 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.148 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.148 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.148 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.148 INFO:teuthology.orchestra.run.gibba038.stdout: "AUDIT_API_LOG_PAYLOAD": { 2021-02-13T17:05:35.148 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2021-02-13T17:05:35.148 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.148 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.148 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.148 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "True", 2021-02-13T17:05:35.148 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.149 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.149 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.149 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.149 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.149 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.149 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.149 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.149 INFO:teuthology.orchestra.run.gibba038.stdout: "ENABLE_BROWSABLE_API": { 2021-02-13T17:05:35.149 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "ENABLE_BROWSABLE_API", 2021-02-13T17:05:35.149 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.149 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.149 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.149 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "True", 2021-02-13T17:05:35.150 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.150 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.150 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.150 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.150 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.150 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.150 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.150 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.150 INFO:teuthology.orchestra.run.gibba038.stdout: "FEATURE_TOGGLE_cephfs": { 2021-02-13T17:05:35.150 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "FEATURE_TOGGLE_cephfs", 2021-02-13T17:05:35.150 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.150 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.150 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.151 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "True", 2021-02-13T17:05:35.151 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.151 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.151 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.151 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.151 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.151 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.151 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.151 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.151 INFO:teuthology.orchestra.run.gibba038.stdout: "FEATURE_TOGGLE_iscsi": { 2021-02-13T17:05:35.151 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "FEATURE_TOGGLE_iscsi", 2021-02-13T17:05:35.151 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.152 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.152 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.152 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "True", 2021-02-13T17:05:35.152 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.152 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.152 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.152 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.152 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.152 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.152 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.152 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.152 INFO:teuthology.orchestra.run.gibba038.stdout: "FEATURE_TOGGLE_mirroring": { 2021-02-13T17:05:35.153 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "FEATURE_TOGGLE_mirroring", 2021-02-13T17:05:35.153 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.153 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.153 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.153 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "True", 2021-02-13T17:05:35.153 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.153 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.153 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.153 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.153 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.153 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.153 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.154 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.154 INFO:teuthology.orchestra.run.gibba038.stdout: "FEATURE_TOGGLE_rbd": { 2021-02-13T17:05:35.154 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "FEATURE_TOGGLE_rbd", 2021-02-13T17:05:35.154 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.154 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.154 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.154 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "True", 2021-02-13T17:05:35.154 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.154 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.154 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.154 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.154 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.155 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.155 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.155 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.155 INFO:teuthology.orchestra.run.gibba038.stdout: "FEATURE_TOGGLE_rgw": { 2021-02-13T17:05:35.155 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "FEATURE_TOGGLE_rgw", 2021-02-13T17:05:35.155 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.155 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.155 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.155 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "True", 2021-02-13T17:05:35.155 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.155 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.156 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.156 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.156 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.156 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.156 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.156 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.156 INFO:teuthology.orchestra.run.gibba038.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-02-13T17:05:35.156 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-02-13T17:05:35.156 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.156 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.156 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.156 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.156 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.157 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.157 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.157 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.157 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.157 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.157 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.157 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.157 INFO:teuthology.orchestra.run.gibba038.stdout: "GRAFANA_API_PASSWORD": { 2021-02-13T17:05:35.157 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "GRAFANA_API_PASSWORD", 2021-02-13T17:05:35.157 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.157 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.157 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.157 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "admin", 2021-02-13T17:05:35.158 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.158 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.158 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.158 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.158 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.158 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.158 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.158 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.158 INFO:teuthology.orchestra.run.gibba038.stdout: "GRAFANA_API_SSL_VERIFY": { 2021-02-13T17:05:35.158 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2021-02-13T17:05:35.158 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.159 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.159 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.159 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "True", 2021-02-13T17:05:35.159 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.159 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.159 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.159 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.159 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.159 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.159 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.159 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.159 INFO:teuthology.orchestra.run.gibba038.stdout: "GRAFANA_API_URL": { 2021-02-13T17:05:35.159 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "GRAFANA_API_URL", 2021-02-13T17:05:35.160 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.160 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.160 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.160 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.160 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.160 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.160 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.160 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.160 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.160 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.160 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.160 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.160 INFO:teuthology.orchestra.run.gibba038.stdout: "GRAFANA_API_USERNAME": { 2021-02-13T17:05:35.160 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "GRAFANA_API_USERNAME", 2021-02-13T17:05:35.161 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.161 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.161 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.161 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "admin", 2021-02-13T17:05:35.161 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.161 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.161 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.161 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.161 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.161 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.161 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.161 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.161 INFO:teuthology.orchestra.run.gibba038.stdout: "GRAFANA_FRONTEND_API_URL": { 2021-02-13T17:05:35.162 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2021-02-13T17:05:35.162 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.162 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.162 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.162 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.162 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.162 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.162 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.162 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.162 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.162 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.162 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.162 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.163 INFO:teuthology.orchestra.run.gibba038.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2021-02-13T17:05:35.163 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-02-13T17:05:35.163 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.163 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.163 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.163 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "False", 2021-02-13T17:05:35.163 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.163 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.163 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.163 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.163 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.163 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.163 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.163 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.164 INFO:teuthology.orchestra.run.gibba038.stdout: "ISCSI_API_SSL_VERIFICATION": { 2021-02-13T17:05:35.164 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2021-02-13T17:05:35.164 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.164 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.164 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.164 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "True", 2021-02-13T17:05:35.164 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.164 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.164 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.164 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.164 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.164 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.164 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.165 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.165 INFO:teuthology.orchestra.run.gibba038.stdout: "PROMETHEUS_API_HOST": { 2021-02-13T17:05:35.165 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "PROMETHEUS_API_HOST", 2021-02-13T17:05:35.165 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.165 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.165 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.165 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.165 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.165 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.165 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.165 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.165 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.165 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.165 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.166 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.166 INFO:teuthology.orchestra.run.gibba038.stdout: "REST_REQUESTS_TIMEOUT": { 2021-02-13T17:05:35.166 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "REST_REQUESTS_TIMEOUT", 2021-02-13T17:05:35.166 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "int", 2021-02-13T17:05:35.166 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.166 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.166 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "45", 2021-02-13T17:05:35.166 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.166 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.166 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.166 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.166 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.166 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.167 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.167 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.167 INFO:teuthology.orchestra.run.gibba038.stdout: "RGW_API_ACCESS_KEY": { 2021-02-13T17:05:35.167 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "RGW_API_ACCESS_KEY", 2021-02-13T17:05:35.167 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.167 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.167 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.167 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.167 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.167 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.167 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.167 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.167 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.167 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.168 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.168 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.168 INFO:teuthology.orchestra.run.gibba038.stdout: "RGW_API_ADMIN_RESOURCE": { 2021-02-13T17:05:35.168 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2021-02-13T17:05:35.168 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.168 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.168 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.168 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "admin", 2021-02-13T17:05:35.168 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.168 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.168 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.168 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.168 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.169 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.169 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.169 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.169 INFO:teuthology.orchestra.run.gibba038.stdout: "RGW_API_HOST": { 2021-02-13T17:05:35.169 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "RGW_API_HOST", 2021-02-13T17:05:35.169 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.169 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.169 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.169 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.169 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.169 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.169 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.169 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.169 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.170 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.170 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.170 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.170 INFO:teuthology.orchestra.run.gibba038.stdout: "RGW_API_PORT": { 2021-02-13T17:05:35.170 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "RGW_API_PORT", 2021-02-13T17:05:35.170 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "int", 2021-02-13T17:05:35.170 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.170 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.170 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "80", 2021-02-13T17:05:35.170 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.170 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.170 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.170 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.171 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.171 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.171 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.171 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.171 INFO:teuthology.orchestra.run.gibba038.stdout: "RGW_API_SCHEME": { 2021-02-13T17:05:35.171 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "RGW_API_SCHEME", 2021-02-13T17:05:35.171 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.171 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.171 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.171 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "http", 2021-02-13T17:05:35.171 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.171 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.171 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.172 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.172 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.172 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.172 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.172 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.172 INFO:teuthology.orchestra.run.gibba038.stdout: "RGW_API_SECRET_KEY": { 2021-02-13T17:05:35.172 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "RGW_API_SECRET_KEY", 2021-02-13T17:05:35.172 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.172 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.172 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.172 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.172 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.172 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.173 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.173 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.173 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.173 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.173 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.173 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.173 INFO:teuthology.orchestra.run.gibba038.stdout: "RGW_API_SSL_VERIFY": { 2021-02-13T17:05:35.173 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "RGW_API_SSL_VERIFY", 2021-02-13T17:05:35.173 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.173 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.173 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.173 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "True", 2021-02-13T17:05:35.173 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.174 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.174 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.174 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.174 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.174 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.174 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.174 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.174 INFO:teuthology.orchestra.run.gibba038.stdout: "RGW_API_USER_ID": { 2021-02-13T17:05:35.174 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "RGW_API_USER_ID", 2021-02-13T17:05:35.174 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.174 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.174 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.174 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.174 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.175 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.175 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.175 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.175 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.175 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.175 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.175 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.175 INFO:teuthology.orchestra.run.gibba038.stdout: "crt_file": { 2021-02-13T17:05:35.175 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "crt_file", 2021-02-13T17:05:35.175 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.175 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.175 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.175 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.176 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.176 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.176 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.176 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.176 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.176 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.176 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.176 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.176 INFO:teuthology.orchestra.run.gibba038.stdout: "debug": { 2021-02-13T17:05:35.176 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "debug", 2021-02-13T17:05:35.176 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.176 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.177 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.177 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "False", 2021-02-13T17:05:35.177 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.177 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.177 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.177 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "Enable/disable debug options", 2021-02-13T17:05:35.177 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.177 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.177 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.177 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.177 INFO:teuthology.orchestra.run.gibba038.stdout: "jwt_token_ttl": { 2021-02-13T17:05:35.177 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "jwt_token_ttl", 2021-02-13T17:05:35.178 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "int", 2021-02-13T17:05:35.178 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.178 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.178 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "28800", 2021-02-13T17:05:35.178 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.178 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.178 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.178 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.178 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.178 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.179 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.179 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.179 INFO:teuthology.orchestra.run.gibba038.stdout: "key_file": { 2021-02-13T17:05:35.179 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "key_file", 2021-02-13T17:05:35.179 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.179 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.179 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.179 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.179 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.179 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.179 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.179 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.179 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.180 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.180 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.180 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.180 INFO:teuthology.orchestra.run.gibba038.stdout: "password": { 2021-02-13T17:05:35.180 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "password", 2021-02-13T17:05:35.180 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.180 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.180 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.180 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.180 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.180 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.180 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.180 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.181 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.181 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.181 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.181 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.181 INFO:teuthology.orchestra.run.gibba038.stdout: "server_addr": { 2021-02-13T17:05:35.181 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "server_addr", 2021-02-13T17:05:35.181 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.181 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.181 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.181 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "::", 2021-02-13T17:05:35.181 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.181 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.181 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.182 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.182 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.182 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.182 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.182 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.182 INFO:teuthology.orchestra.run.gibba038.stdout: "server_port": { 2021-02-13T17:05:35.182 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "server_port", 2021-02-13T17:05:35.182 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "int", 2021-02-13T17:05:35.182 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.182 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.182 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "8080", 2021-02-13T17:05:35.182 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.182 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.183 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.183 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.183 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.183 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.183 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.183 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.183 INFO:teuthology.orchestra.run.gibba038.stdout: "ssl": { 2021-02-13T17:05:35.183 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "ssl", 2021-02-13T17:05:35.183 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.183 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.183 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.183 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "True", 2021-02-13T17:05:35.183 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.184 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.184 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.184 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.184 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.184 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.184 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.184 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.184 INFO:teuthology.orchestra.run.gibba038.stdout: "ssl_server_port": { 2021-02-13T17:05:35.184 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "ssl_server_port", 2021-02-13T17:05:35.184 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "int", 2021-02-13T17:05:35.184 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.184 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.184 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "8443", 2021-02-13T17:05:35.184 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.185 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.185 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.185 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.185 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.185 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.185 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.185 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.185 INFO:teuthology.orchestra.run.gibba038.stdout: "standby_behaviour": { 2021-02-13T17:05:35.185 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "standby_behaviour", 2021-02-13T17:05:35.185 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.185 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.185 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.185 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "redirect", 2021-02-13T17:05:35.186 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.186 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.186 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [ 2021-02-13T17:05:35.186 INFO:teuthology.orchestra.run.gibba038.stdout: "error", 2021-02-13T17:05:35.186 INFO:teuthology.orchestra.run.gibba038.stdout: "redirect" 2021-02-13T17:05:35.186 INFO:teuthology.orchestra.run.gibba038.stdout: ], 2021-02-13T17:05:35.186 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.186 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.186 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.186 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.186 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.186 INFO:teuthology.orchestra.run.gibba038.stdout: "standby_error_status_code": { 2021-02-13T17:05:35.187 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "standby_error_status_code", 2021-02-13T17:05:35.187 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "int", 2021-02-13T17:05:35.187 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.187 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.187 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "500", 2021-02-13T17:05:35.187 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "400", 2021-02-13T17:05:35.187 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "599", 2021-02-13T17:05:35.187 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.187 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.187 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.187 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.187 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.187 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.188 INFO:teuthology.orchestra.run.gibba038.stdout: "url_prefix": { 2021-02-13T17:05:35.188 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "url_prefix", 2021-02-13T17:05:35.188 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.188 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.188 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.188 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.188 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.188 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.188 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.188 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.188 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.188 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.188 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.188 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.189 INFO:teuthology.orchestra.run.gibba038.stdout: "username": { 2021-02-13T17:05:35.189 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "username", 2021-02-13T17:05:35.189 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.189 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.189 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.189 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.189 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.189 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.189 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.189 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.189 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.189 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.189 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.190 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.190 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.190 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.190 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.190 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "deepsea", 2021-02-13T17:05:35.190 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.190 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.190 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.190 INFO:teuthology.orchestra.run.gibba038.stdout: "salt_api_eauth": { 2021-02-13T17:05:35.190 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "salt_api_eauth", 2021-02-13T17:05:35.190 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.190 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.190 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.191 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "sharedsecret", 2021-02-13T17:05:35.191 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.191 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.191 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.191 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.191 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.191 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.191 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.191 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.191 INFO:teuthology.orchestra.run.gibba038.stdout: "salt_api_password": { 2021-02-13T17:05:35.191 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "salt_api_password", 2021-02-13T17:05:35.191 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.191 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.191 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.192 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.192 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.192 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.192 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.192 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.192 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.192 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.192 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.192 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.192 INFO:teuthology.orchestra.run.gibba038.stdout: "salt_api_url": { 2021-02-13T17:05:35.192 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "salt_api_url", 2021-02-13T17:05:35.192 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.192 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.192 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.193 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.193 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.193 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.193 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.193 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.193 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.193 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.193 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.193 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.193 INFO:teuthology.orchestra.run.gibba038.stdout: "salt_api_username": { 2021-02-13T17:05:35.193 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "salt_api_username", 2021-02-13T17:05:35.193 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.193 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.194 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.194 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.194 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.194 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.194 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.194 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.194 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.194 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.194 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.194 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.194 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.194 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.194 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.194 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "devicehealth", 2021-02-13T17:05:35.195 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.195 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.195 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.195 INFO:teuthology.orchestra.run.gibba038.stdout: "enable_monitoring": { 2021-02-13T17:05:35.195 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "enable_monitoring", 2021-02-13T17:05:35.195 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.195 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.195 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.195 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "False", 2021-02-13T17:05:35.195 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.195 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.195 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.195 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "monitor device health metrics", 2021-02-13T17:05:35.196 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.196 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.196 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.196 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.196 INFO:teuthology.orchestra.run.gibba038.stdout: "mark_out_threshold": { 2021-02-13T17:05:35.196 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "mark_out_threshold", 2021-02-13T17:05:35.196 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "secs", 2021-02-13T17:05:35.196 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.196 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.196 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "2419200", 2021-02-13T17:05:35.196 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.196 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.196 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.197 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "automatically mark OSD if it may fail before this long", 2021-02-13T17:05:35.197 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.197 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.197 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.197 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.197 INFO:teuthology.orchestra.run.gibba038.stdout: "pool_name": { 2021-02-13T17:05:35.197 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "pool_name", 2021-02-13T17:05:35.197 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.197 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.197 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.197 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "device_health_metrics", 2021-02-13T17:05:35.197 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.197 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.197 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.198 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "name of pool in which to store device health metrics", 2021-02-13T17:05:35.198 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.198 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.198 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.198 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.198 INFO:teuthology.orchestra.run.gibba038.stdout: "retention_period": { 2021-02-13T17:05:35.198 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "retention_period", 2021-02-13T17:05:35.198 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "secs", 2021-02-13T17:05:35.198 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.198 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.198 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "15552000", 2021-02-13T17:05:35.198 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.198 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.199 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.199 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "how long to retain device health metrics", 2021-02-13T17:05:35.199 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.199 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.199 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.199 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.199 INFO:teuthology.orchestra.run.gibba038.stdout: "scrape_frequency": { 2021-02-13T17:05:35.199 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "scrape_frequency", 2021-02-13T17:05:35.199 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "secs", 2021-02-13T17:05:35.199 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.199 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.199 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "86400", 2021-02-13T17:05:35.199 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.200 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.200 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.200 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "how frequently to scrape device health metrics", 2021-02-13T17:05:35.200 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.200 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.200 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.200 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.200 INFO:teuthology.orchestra.run.gibba038.stdout: "self_heal": { 2021-02-13T17:05:35.200 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "self_heal", 2021-02-13T17:05:35.200 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.200 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.200 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.200 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "True", 2021-02-13T17:05:35.201 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.201 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.201 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.201 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "preemptively heal cluster around devices that may fail", 2021-02-13T17:05:35.201 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.201 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.201 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.201 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.201 INFO:teuthology.orchestra.run.gibba038.stdout: "sleep_interval": { 2021-02-13T17:05:35.201 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "sleep_interval", 2021-02-13T17:05:35.201 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "secs", 2021-02-13T17:05:35.201 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.201 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.201 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "600", 2021-02-13T17:05:35.202 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.202 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.202 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.202 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "how frequently to wake up and check device health", 2021-02-13T17:05:35.202 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.202 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.202 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.202 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.202 INFO:teuthology.orchestra.run.gibba038.stdout: "warn_threshold": { 2021-02-13T17:05:35.202 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "warn_threshold", 2021-02-13T17:05:35.202 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "secs", 2021-02-13T17:05:35.202 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.203 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.203 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "7257600", 2021-02-13T17:05:35.203 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.203 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.203 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.203 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "raise health warning if OSD may fail before this long", 2021-02-13T17:05:35.203 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.203 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.203 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.203 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.203 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.203 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.203 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.204 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "diskprediction_cloud", 2021-02-13T17:05:35.204 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.204 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.204 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.204 INFO:teuthology.orchestra.run.gibba038.stdout: "diskprediction_cert_context": { 2021-02-13T17:05:35.204 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "diskprediction_cert_context", 2021-02-13T17:05:35.204 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.204 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.204 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.204 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.204 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.204 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.204 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.205 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.205 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.205 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.205 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.205 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.205 INFO:teuthology.orchestra.run.gibba038.stdout: "diskprediction_default_authority": { 2021-02-13T17:05:35.205 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "diskprediction_default_authority", 2021-02-13T17:05:35.205 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.205 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.205 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.205 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "localhost", 2021-02-13T17:05:35.205 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.205 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.206 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.206 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.206 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.206 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.206 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.206 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.206 INFO:teuthology.orchestra.run.gibba038.stdout: "diskprediction_password": { 2021-02-13T17:05:35.206 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "diskprediction_password", 2021-02-13T17:05:35.206 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.206 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.206 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.207 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.207 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.207 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.207 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.207 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.207 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.207 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.207 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.207 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.207 INFO:teuthology.orchestra.run.gibba038.stdout: "diskprediction_port": { 2021-02-13T17:05:35.207 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "diskprediction_port", 2021-02-13T17:05:35.207 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.208 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.208 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.208 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "31400", 2021-02-13T17:05:35.208 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.208 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.208 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.208 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.208 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.208 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.208 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.208 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.208 INFO:teuthology.orchestra.run.gibba038.stdout: "diskprediction_retrieve_prediction_interval": { 2021-02-13T17:05:35.208 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "diskprediction_retrieve_prediction_interval", 2021-02-13T17:05:35.209 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.209 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.209 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.209 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "43200", 2021-02-13T17:05:35.209 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.209 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.209 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.209 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.209 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.209 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.209 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.209 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.209 INFO:teuthology.orchestra.run.gibba038.stdout: "diskprediction_server": { 2021-02-13T17:05:35.209 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "diskprediction_server", 2021-02-13T17:05:35.210 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.210 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.210 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.210 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.210 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.210 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.210 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.210 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.210 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.210 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.210 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.210 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.210 INFO:teuthology.orchestra.run.gibba038.stdout: "diskprediction_ssl_target_name_override": { 2021-02-13T17:05:35.211 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "diskprediction_ssl_target_name_override", 2021-02-13T17:05:35.211 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.211 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.211 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.211 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "localhost", 2021-02-13T17:05:35.211 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.211 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.211 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.211 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.211 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.211 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.211 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.211 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.212 INFO:teuthology.orchestra.run.gibba038.stdout: "diskprediction_upload_metrics_interval": { 2021-02-13T17:05:35.212 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "diskprediction_upload_metrics_interval", 2021-02-13T17:05:35.212 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.212 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.212 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.212 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "600", 2021-02-13T17:05:35.212 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.212 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.212 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.212 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.212 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.212 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.212 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.213 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.213 INFO:teuthology.orchestra.run.gibba038.stdout: "diskprediction_upload_smart_interval": { 2021-02-13T17:05:35.213 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "diskprediction_upload_smart_interval", 2021-02-13T17:05:35.213 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.213 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.213 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.213 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "43200", 2021-02-13T17:05:35.213 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.213 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.213 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.213 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.213 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.213 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.214 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.214 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.214 INFO:teuthology.orchestra.run.gibba038.stdout: "diskprediction_user": { 2021-02-13T17:05:35.214 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "diskprediction_user", 2021-02-13T17:05:35.214 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.214 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.214 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.214 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.214 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.214 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.214 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.214 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.214 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.215 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.215 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.215 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.215 INFO:teuthology.orchestra.run.gibba038.stdout: "sleep_interval": { 2021-02-13T17:05:35.215 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "sleep_interval", 2021-02-13T17:05:35.215 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.215 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.215 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.215 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "600", 2021-02-13T17:05:35.215 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.215 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.215 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.215 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.216 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.216 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.216 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.216 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.216 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.216 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.216 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.216 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "diskprediction_local", 2021-02-13T17:05:35.216 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.216 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.216 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.216 INFO:teuthology.orchestra.run.gibba038.stdout: "predict_interval": { 2021-02-13T17:05:35.216 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "predict_interval", 2021-02-13T17:05:35.216 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.217 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.217 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.217 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "86400", 2021-02-13T17:05:35.217 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.217 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.217 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.217 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.217 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.217 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.217 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.217 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.217 INFO:teuthology.orchestra.run.gibba038.stdout: "sleep_interval": { 2021-02-13T17:05:35.217 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "sleep_interval", 2021-02-13T17:05:35.218 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.218 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.218 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.218 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "600", 2021-02-13T17:05:35.218 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.218 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.218 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.218 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.218 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.218 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.218 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.218 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.219 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.219 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.219 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.219 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "influx", 2021-02-13T17:05:35.219 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": false, 2021-02-13T17:05:35.219 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "influxdb python module not found", 2021-02-13T17:05:35.219 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.219 INFO:teuthology.orchestra.run.gibba038.stdout: "batch_size": { 2021-02-13T17:05:35.219 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "batch_size", 2021-02-13T17:05:35.219 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.219 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.219 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.219 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "5000", 2021-02-13T17:05:35.219 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.220 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.220 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.220 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.220 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.220 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.220 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.220 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.220 INFO:teuthology.orchestra.run.gibba038.stdout: "database": { 2021-02-13T17:05:35.220 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "database", 2021-02-13T17:05:35.220 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.220 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.220 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.220 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "ceph", 2021-02-13T17:05:35.221 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.221 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.221 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.221 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.221 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.221 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.221 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.221 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.221 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": { 2021-02-13T17:05:35.221 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "hostname", 2021-02-13T17:05:35.221 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.221 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.221 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.222 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "None", 2021-02-13T17:05:35.222 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.222 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.222 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.222 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.222 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.222 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.222 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.222 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.222 INFO:teuthology.orchestra.run.gibba038.stdout: "interval": { 2021-02-13T17:05:35.222 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "interval", 2021-02-13T17:05:35.222 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.222 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.223 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.223 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "30", 2021-02-13T17:05:35.223 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.223 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.223 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.223 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.223 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.223 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.223 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.223 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.223 INFO:teuthology.orchestra.run.gibba038.stdout: "password": { 2021-02-13T17:05:35.223 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "password", 2021-02-13T17:05:35.224 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.224 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.224 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.224 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "None", 2021-02-13T17:05:35.224 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.224 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.224 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.224 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.224 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.224 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.224 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.224 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.224 INFO:teuthology.orchestra.run.gibba038.stdout: "port": { 2021-02-13T17:05:35.225 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "port", 2021-02-13T17:05:35.225 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.225 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.225 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.225 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "8086", 2021-02-13T17:05:35.225 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.225 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.225 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.225 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.225 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.225 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.225 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.226 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.226 INFO:teuthology.orchestra.run.gibba038.stdout: "ssl": { 2021-02-13T17:05:35.226 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "ssl", 2021-02-13T17:05:35.226 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.226 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.226 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.226 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "false", 2021-02-13T17:05:35.226 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.226 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.226 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.226 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.226 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.227 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.227 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.227 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.227 INFO:teuthology.orchestra.run.gibba038.stdout: "threads": { 2021-02-13T17:05:35.227 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "threads", 2021-02-13T17:05:35.227 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.227 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.227 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.227 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "5", 2021-02-13T17:05:35.227 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.227 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.227 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.227 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.227 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.228 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.228 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.228 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.228 INFO:teuthology.orchestra.run.gibba038.stdout: "username": { 2021-02-13T17:05:35.228 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "username", 2021-02-13T17:05:35.228 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.228 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.228 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.228 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "None", 2021-02-13T17:05:35.228 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.228 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.228 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.228 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.229 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.229 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.229 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.229 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.229 INFO:teuthology.orchestra.run.gibba038.stdout: "verify_ssl": { 2021-02-13T17:05:35.229 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "verify_ssl", 2021-02-13T17:05:35.229 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.229 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.229 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.229 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "true", 2021-02-13T17:05:35.229 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.229 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.230 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.230 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.230 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.230 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.230 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.230 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.230 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.230 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.230 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.230 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "insights", 2021-02-13T17:05:35.230 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.230 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.230 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": {} 2021-02-13T17:05:35.231 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.231 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.231 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "iostat", 2021-02-13T17:05:35.231 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.231 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.231 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": {} 2021-02-13T17:05:35.231 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.231 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.231 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "localpool", 2021-02-13T17:05:35.231 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.231 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.231 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.231 INFO:teuthology.orchestra.run.gibba038.stdout: "failure_domain": { 2021-02-13T17:05:35.232 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "failure_domain", 2021-02-13T17:05:35.232 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.232 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.232 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.232 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "host", 2021-02-13T17:05:35.232 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.232 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.232 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.232 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "failure domain for any created local pool", 2021-02-13T17:05:35.232 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.232 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.232 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.232 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.233 INFO:teuthology.orchestra.run.gibba038.stdout: "min_size": { 2021-02-13T17:05:35.233 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "min_size", 2021-02-13T17:05:35.233 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "int", 2021-02-13T17:05:35.233 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.233 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.233 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.233 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.233 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.233 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.233 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "default min_size for any created local pool", 2021-02-13T17:05:35.233 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.233 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.233 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.234 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.234 INFO:teuthology.orchestra.run.gibba038.stdout: "num_rep": { 2021-02-13T17:05:35.234 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "num_rep", 2021-02-13T17:05:35.234 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "int", 2021-02-13T17:05:35.234 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.234 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.234 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "3", 2021-02-13T17:05:35.234 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.234 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.234 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.234 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "default replica count for any created local pool", 2021-02-13T17:05:35.234 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.234 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.235 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.235 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.235 INFO:teuthology.orchestra.run.gibba038.stdout: "pg_num": { 2021-02-13T17:05:35.235 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "pg_num", 2021-02-13T17:05:35.235 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "int", 2021-02-13T17:05:35.235 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.235 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.235 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "128", 2021-02-13T17:05:35.235 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.235 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.235 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.235 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "default pg_num for any created local pool", 2021-02-13T17:05:35.235 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.235 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.236 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.236 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.236 INFO:teuthology.orchestra.run.gibba038.stdout: "prefix": { 2021-02-13T17:05:35.236 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "prefix", 2021-02-13T17:05:35.236 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.236 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.236 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.236 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.236 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.236 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.236 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.236 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "name prefix for any created local pool", 2021-02-13T17:05:35.237 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.237 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.237 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.237 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.237 INFO:teuthology.orchestra.run.gibba038.stdout: "subtree": { 2021-02-13T17:05:35.237 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "subtree", 2021-02-13T17:05:35.237 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.237 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.237 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.237 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "rack", 2021-02-13T17:05:35.237 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.237 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.237 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.238 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "CRUSH level for which to create a local pool", 2021-02-13T17:05:35.238 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.238 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.238 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.238 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.238 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.238 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.238 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.238 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "orchestrator_cli", 2021-02-13T17:05:35.238 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.238 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.238 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.239 INFO:teuthology.orchestra.run.gibba038.stdout: "orchestrator": { 2021-02-13T17:05:35.239 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "orchestrator", 2021-02-13T17:05:35.239 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.239 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.239 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.239 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.239 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.239 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.239 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.239 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.239 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.239 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.239 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.239 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.240 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.240 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.240 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.240 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "pg_autoscaler", 2021-02-13T17:05:35.240 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.240 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.240 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.240 INFO:teuthology.orchestra.run.gibba038.stdout: "sleep_interval": { 2021-02-13T17:05:35.240 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "sleep_interval", 2021-02-13T17:05:35.240 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.240 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.241 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.241 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "60", 2021-02-13T17:05:35.241 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.241 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.241 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.241 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.241 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.241 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.241 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.241 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.241 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.241 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.241 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.242 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "progress", 2021-02-13T17:05:35.242 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.242 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.242 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.242 INFO:teuthology.orchestra.run.gibba038.stdout: "enabled": { 2021-02-13T17:05:35.242 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "enabled", 2021-02-13T17:05:35.242 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.242 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.242 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.242 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "True", 2021-02-13T17:05:35.242 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.242 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.243 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.243 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.243 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.243 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.243 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.243 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.243 INFO:teuthology.orchestra.run.gibba038.stdout: "max_completed_events": { 2021-02-13T17:05:35.243 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "max_completed_events", 2021-02-13T17:05:35.243 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "int", 2021-02-13T17:05:35.243 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.243 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.243 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "50", 2021-02-13T17:05:35.243 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.244 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.244 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.244 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "number of past completed events to remember", 2021-02-13T17:05:35.244 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.244 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.244 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.244 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.244 INFO:teuthology.orchestra.run.gibba038.stdout: "persist_interval": { 2021-02-13T17:05:35.244 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "persist_interval", 2021-02-13T17:05:35.244 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "secs", 2021-02-13T17:05:35.244 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.244 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 1, 2021-02-13T17:05:35.245 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "5", 2021-02-13T17:05:35.245 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.245 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.245 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.245 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "how frequently to persist completed events", 2021-02-13T17:05:35.245 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.245 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.245 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.245 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.245 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.245 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.245 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.245 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "prometheus", 2021-02-13T17:05:35.245 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.246 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.246 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.246 INFO:teuthology.orchestra.run.gibba038.stdout: "rbd_stats_pools": { 2021-02-13T17:05:35.246 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "rbd_stats_pools", 2021-02-13T17:05:35.246 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.246 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.246 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.246 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.246 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.246 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.246 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.246 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.247 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.247 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.247 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.247 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.247 INFO:teuthology.orchestra.run.gibba038.stdout: "rbd_stats_pools_refresh_interval": { 2021-02-13T17:05:35.247 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "rbd_stats_pools_refresh_interval", 2021-02-13T17:05:35.247 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "int", 2021-02-13T17:05:35.247 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.247 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.247 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "300", 2021-02-13T17:05:35.247 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.247 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.247 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.248 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.248 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.248 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.248 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.248 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.248 INFO:teuthology.orchestra.run.gibba038.stdout: "scrape_interval": { 2021-02-13T17:05:35.248 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "scrape_interval", 2021-02-13T17:05:35.248 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.248 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.248 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.248 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.248 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.248 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.249 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.249 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.249 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.249 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.249 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.249 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.249 INFO:teuthology.orchestra.run.gibba038.stdout: "server_addr": { 2021-02-13T17:05:35.249 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "server_addr", 2021-02-13T17:05:35.249 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.249 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.249 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.249 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.249 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.250 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.250 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.250 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.250 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.250 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.250 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.250 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.250 INFO:teuthology.orchestra.run.gibba038.stdout: "server_port": { 2021-02-13T17:05:35.250 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "server_port", 2021-02-13T17:05:35.250 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.250 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.250 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.250 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.251 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.251 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.251 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.251 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.251 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.251 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.251 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.251 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.251 INFO:teuthology.orchestra.run.gibba038.stdout: "stale_cache_strategy": { 2021-02-13T17:05:35.251 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "stale_cache_strategy", 2021-02-13T17:05:35.251 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.251 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.251 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.251 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.252 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.252 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.252 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.252 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.252 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.252 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.252 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.252 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.252 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.252 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.252 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.252 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "rbd_support", 2021-02-13T17:05:35.253 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.253 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.253 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": {} 2021-02-13T17:05:35.253 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.253 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.253 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "restful", 2021-02-13T17:05:35.253 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.253 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.253 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.253 INFO:teuthology.orchestra.run.gibba038.stdout: "key_file": { 2021-02-13T17:05:35.253 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "key_file", 2021-02-13T17:05:35.253 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.253 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.253 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.254 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.254 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.254 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.254 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.254 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.254 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.254 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.254 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.254 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.254 INFO:teuthology.orchestra.run.gibba038.stdout: "server_addr": { 2021-02-13T17:05:35.254 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "server_addr", 2021-02-13T17:05:35.254 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.255 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.255 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.255 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.255 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.255 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.255 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.255 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.255 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.255 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.255 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.255 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.255 INFO:teuthology.orchestra.run.gibba038.stdout: "server_port": { 2021-02-13T17:05:35.256 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "server_port", 2021-02-13T17:05:35.256 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.256 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.256 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.256 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.256 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.256 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.256 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.256 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.256 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.256 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.256 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.256 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.257 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.257 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.257 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.257 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "rook", 2021-02-13T17:05:35.257 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.257 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.257 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": {} 2021-02-13T17:05:35.257 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.257 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.257 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "selftest", 2021-02-13T17:05:35.257 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.258 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.258 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.258 INFO:teuthology.orchestra.run.gibba038.stdout: "roption1": { 2021-02-13T17:05:35.258 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "roption1", 2021-02-13T17:05:35.258 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.258 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.258 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.258 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.258 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.258 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.258 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.258 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.259 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.259 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.259 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.259 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.259 INFO:teuthology.orchestra.run.gibba038.stdout: "roption2": { 2021-02-13T17:05:35.259 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "roption2", 2021-02-13T17:05:35.259 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.259 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.259 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.259 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "xyz", 2021-02-13T17:05:35.259 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.259 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.259 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.260 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.260 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.260 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.260 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.260 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.260 INFO:teuthology.orchestra.run.gibba038.stdout: "rwoption1": { 2021-02-13T17:05:35.260 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "rwoption1", 2021-02-13T17:05:35.260 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.260 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.260 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.260 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.260 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.261 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.261 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.261 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.261 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.261 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.261 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.261 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.261 INFO:teuthology.orchestra.run.gibba038.stdout: "rwoption2": { 2021-02-13T17:05:35.261 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "rwoption2", 2021-02-13T17:05:35.261 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "int", 2021-02-13T17:05:35.261 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.261 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.261 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.262 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.262 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.262 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.262 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.262 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.262 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.262 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.262 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.262 INFO:teuthology.orchestra.run.gibba038.stdout: "rwoption3": { 2021-02-13T17:05:35.262 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "rwoption3", 2021-02-13T17:05:35.262 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "float", 2021-02-13T17:05:35.262 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.263 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.263 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.263 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.263 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.263 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.263 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.263 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.263 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.263 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.263 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.263 INFO:teuthology.orchestra.run.gibba038.stdout: "rwoption4": { 2021-02-13T17:05:35.263 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "rwoption4", 2021-02-13T17:05:35.263 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.264 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.264 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.264 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.264 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.264 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.264 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.264 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.264 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.264 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.264 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.264 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.264 INFO:teuthology.orchestra.run.gibba038.stdout: "rwoption5": { 2021-02-13T17:05:35.265 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "rwoption5", 2021-02-13T17:05:35.265 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.265 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.265 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.265 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.265 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.265 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.265 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.265 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.265 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.265 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.265 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.265 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.265 INFO:teuthology.orchestra.run.gibba038.stdout: "rwoption6": { 2021-02-13T17:05:35.266 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "rwoption6", 2021-02-13T17:05:35.266 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.266 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.266 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.266 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "True", 2021-02-13T17:05:35.266 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.266 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.266 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.266 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.266 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.266 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.266 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.267 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.267 INFO:teuthology.orchestra.run.gibba038.stdout: "testkey": { 2021-02-13T17:05:35.267 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "testkey", 2021-02-13T17:05:35.267 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.267 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.267 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.267 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.267 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.267 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.267 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.267 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.267 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.267 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.267 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.268 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.268 INFO:teuthology.orchestra.run.gibba038.stdout: "testlkey": { 2021-02-13T17:05:35.268 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "testlkey", 2021-02-13T17:05:35.268 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.268 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.268 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.268 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.268 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.268 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.268 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.268 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.268 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.268 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.269 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.269 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.269 INFO:teuthology.orchestra.run.gibba038.stdout: "testnewline": { 2021-02-13T17:05:35.269 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "testnewline", 2021-02-13T17:05:35.269 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.269 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.269 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.269 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.269 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.269 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.269 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.269 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.269 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.270 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.270 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.270 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.270 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.270 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.270 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.270 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "ssh", 2021-02-13T17:05:35.270 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.270 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.270 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.270 INFO:teuthology.orchestra.run.gibba038.stdout: "inventory_cache_timeout_min": { 2021-02-13T17:05:35.271 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "inventory_cache_timeout_min", 2021-02-13T17:05:35.271 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.271 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.271 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.271 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.271 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.271 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.271 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.271 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.271 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.271 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.271 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.271 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.272 INFO:teuthology.orchestra.run.gibba038.stdout: "ssh_config_file": { 2021-02-13T17:05:35.272 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "ssh_config_file", 2021-02-13T17:05:35.272 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.272 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.272 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.272 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.272 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.272 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.272 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.272 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.272 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.272 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.272 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.273 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.273 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.273 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.273 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.273 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "status", 2021-02-13T17:05:35.273 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.273 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.273 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": {} 2021-02-13T17:05:35.273 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.273 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.273 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "telegraf", 2021-02-13T17:05:35.273 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.273 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.274 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.274 INFO:teuthology.orchestra.run.gibba038.stdout: "address": { 2021-02-13T17:05:35.274 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "address", 2021-02-13T17:05:35.274 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.274 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.274 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.274 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2021-02-13T17:05:35.274 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.274 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.274 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.274 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.274 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.274 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.275 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.275 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.275 INFO:teuthology.orchestra.run.gibba038.stdout: "interval": { 2021-02-13T17:05:35.275 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "interval", 2021-02-13T17:05:35.275 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "secs", 2021-02-13T17:05:35.275 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.275 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.275 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "15", 2021-02-13T17:05:35.275 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.275 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.275 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.275 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.276 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.276 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.276 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.276 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.276 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.276 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.276 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.276 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "telemetry", 2021-02-13T17:05:35.276 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.276 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.276 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.276 INFO:teuthology.orchestra.run.gibba038.stdout: "channel_basic": { 2021-02-13T17:05:35.276 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "channel_basic", 2021-02-13T17:05:35.276 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.277 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.277 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.277 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "True", 2021-02-13T17:05:35.277 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.277 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.277 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.277 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "Share basic cluster information (size, version)", 2021-02-13T17:05:35.277 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.277 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.277 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.277 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.277 INFO:teuthology.orchestra.run.gibba038.stdout: "channel_crash": { 2021-02-13T17:05:35.278 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "channel_crash", 2021-02-13T17:05:35.278 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.278 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.278 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.278 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "True", 2021-02-13T17:05:35.278 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.278 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.278 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.278 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.278 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.278 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.278 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.278 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.279 INFO:teuthology.orchestra.run.gibba038.stdout: "channel_device": { 2021-02-13T17:05:35.279 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "channel_device", 2021-02-13T17:05:35.279 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.279 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.279 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.279 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "True", 2021-02-13T17:05:35.279 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.279 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.279 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.279 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.279 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.279 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.280 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.280 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.280 INFO:teuthology.orchestra.run.gibba038.stdout: "channel_ident": { 2021-02-13T17:05:35.280 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "channel_ident", 2021-02-13T17:05:35.280 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.280 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.280 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.280 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "False", 2021-02-13T17:05:35.280 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.280 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.280 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.280 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.280 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.281 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.281 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.281 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.281 INFO:teuthology.orchestra.run.gibba038.stdout: "contact": { 2021-02-13T17:05:35.281 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "contact", 2021-02-13T17:05:35.281 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.281 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.281 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.281 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "None", 2021-02-13T17:05:35.281 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.281 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.281 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.281 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.281 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.282 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.282 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.282 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.282 INFO:teuthology.orchestra.run.gibba038.stdout: "description": { 2021-02-13T17:05:35.282 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "description", 2021-02-13T17:05:35.282 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.282 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.282 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.282 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "None", 2021-02-13T17:05:35.282 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.282 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.282 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.283 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.283 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.283 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.283 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.283 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.283 INFO:teuthology.orchestra.run.gibba038.stdout: "device_url": { 2021-02-13T17:05:35.283 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "device_url", 2021-02-13T17:05:35.283 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.283 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.283 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.283 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "https://telemetry.ceph.com/device", 2021-02-13T17:05:35.283 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.283 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.284 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.284 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.284 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.284 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.284 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.284 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.284 INFO:teuthology.orchestra.run.gibba038.stdout: "enabled": { 2021-02-13T17:05:35.284 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "enabled", 2021-02-13T17:05:35.284 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.284 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.284 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.284 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "False", 2021-02-13T17:05:35.284 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.285 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.285 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.285 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.285 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.285 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.285 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.285 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.285 INFO:teuthology.orchestra.run.gibba038.stdout: "interval": { 2021-02-13T17:05:35.285 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "interval", 2021-02-13T17:05:35.285 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "int", 2021-02-13T17:05:35.285 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.285 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.285 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "24", 2021-02-13T17:05:35.286 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "8", 2021-02-13T17:05:35.286 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.286 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.286 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.286 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.286 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.286 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.286 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.286 INFO:teuthology.orchestra.run.gibba038.stdout: "last_opt_revision": { 2021-02-13T17:05:35.286 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "last_opt_revision", 2021-02-13T17:05:35.286 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "int", 2021-02-13T17:05:35.286 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.287 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.287 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "1", 2021-02-13T17:05:35.287 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.287 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.287 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.287 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.287 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.287 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.287 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.287 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.287 INFO:teuthology.orchestra.run.gibba038.stdout: "leaderboard": { 2021-02-13T17:05:35.287 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "leaderboard", 2021-02-13T17:05:35.287 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "bool", 2021-02-13T17:05:35.288 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.288 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.288 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "False", 2021-02-13T17:05:35.288 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.288 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.288 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.288 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.288 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.288 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.288 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.288 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.288 INFO:teuthology.orchestra.run.gibba038.stdout: "organization": { 2021-02-13T17:05:35.288 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "organization", 2021-02-13T17:05:35.289 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.289 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.289 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.289 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "None", 2021-02-13T17:05:35.289 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.289 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.289 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.289 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.289 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.289 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.289 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.289 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.289 INFO:teuthology.orchestra.run.gibba038.stdout: "proxy": { 2021-02-13T17:05:35.290 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "proxy", 2021-02-13T17:05:35.290 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.290 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.290 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.290 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "None", 2021-02-13T17:05:35.290 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.290 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.290 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.290 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.290 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.290 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.290 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.290 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.291 INFO:teuthology.orchestra.run.gibba038.stdout: "url": { 2021-02-13T17:05:35.291 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "url", 2021-02-13T17:05:35.291 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.291 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.291 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.291 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "https://telemetry.ceph.com/report", 2021-02-13T17:05:35.291 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.291 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.291 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.291 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.291 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.291 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.291 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.291 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.292 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.292 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.292 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.292 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "test_orchestrator", 2021-02-13T17:05:35.292 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.292 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.292 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": {} 2021-02-13T17:05:35.292 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.292 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.292 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "volumes", 2021-02-13T17:05:35.292 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.292 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.292 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.293 INFO:teuthology.orchestra.run.gibba038.stdout: "max_concurrent_clones": { 2021-02-13T17:05:35.293 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "max_concurrent_clones", 2021-02-13T17:05:35.293 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "int", 2021-02-13T17:05:35.293 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.293 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.293 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "4", 2021-02-13T17:05:35.293 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.293 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.293 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.293 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "Number of asynchronous cloner threads", 2021-02-13T17:05:35.293 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.293 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.293 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.293 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.294 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.294 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.294 INFO:teuthology.orchestra.run.gibba038.stdout: { 2021-02-13T17:05:35.294 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "zabbix", 2021-02-13T17:05:35.294 INFO:teuthology.orchestra.run.gibba038.stdout: "can_run": true, 2021-02-13T17:05:35.294 INFO:teuthology.orchestra.run.gibba038.stdout: "error_string": "", 2021-02-13T17:05:35.294 INFO:teuthology.orchestra.run.gibba038.stdout: "module_options": { 2021-02-13T17:05:35.294 INFO:teuthology.orchestra.run.gibba038.stdout: "identifier": { 2021-02-13T17:05:35.294 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "identifier", 2021-02-13T17:05:35.294 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.294 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.294 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.294 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "", 2021-02-13T17:05:35.295 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.295 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.295 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.295 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.295 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.295 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.295 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.295 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.295 INFO:teuthology.orchestra.run.gibba038.stdout: "interval": { 2021-02-13T17:05:35.295 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "interval", 2021-02-13T17:05:35.295 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "secs", 2021-02-13T17:05:35.295 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.295 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.296 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "60", 2021-02-13T17:05:35.296 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.296 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.296 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.296 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.296 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.296 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.296 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.296 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.296 INFO:teuthology.orchestra.run.gibba038.stdout: "zabbix_host": { 2021-02-13T17:05:35.296 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "zabbix_host", 2021-02-13T17:05:35.296 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.296 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.296 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.297 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "None", 2021-02-13T17:05:35.297 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.297 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.297 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.297 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.297 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.297 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.297 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.297 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.297 INFO:teuthology.orchestra.run.gibba038.stdout: "zabbix_port": { 2021-02-13T17:05:35.297 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "zabbix_port", 2021-02-13T17:05:35.297 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "int", 2021-02-13T17:05:35.297 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.298 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.298 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "10051", 2021-02-13T17:05:35.298 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.298 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.298 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.298 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.298 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.298 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.298 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.298 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.298 INFO:teuthology.orchestra.run.gibba038.stdout: "zabbix_sender": { 2021-02-13T17:05:35.298 INFO:teuthology.orchestra.run.gibba038.stdout: "name": "zabbix_sender", 2021-02-13T17:05:35.299 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "str", 2021-02-13T17:05:35.299 INFO:teuthology.orchestra.run.gibba038.stdout: "level": "advanced", 2021-02-13T17:05:35.299 INFO:teuthology.orchestra.run.gibba038.stdout: "flags": 0, 2021-02-13T17:05:35.299 INFO:teuthology.orchestra.run.gibba038.stdout: "default_value": "/usr/bin/zabbix_sender", 2021-02-13T17:05:35.299 INFO:teuthology.orchestra.run.gibba038.stdout: "min": "", 2021-02-13T17:05:35.299 INFO:teuthology.orchestra.run.gibba038.stdout: "max": "", 2021-02-13T17:05:35.299 INFO:teuthology.orchestra.run.gibba038.stdout: "enum_allowed": [], 2021-02-13T17:05:35.299 INFO:teuthology.orchestra.run.gibba038.stdout: "desc": "", 2021-02-13T17:05:35.299 INFO:teuthology.orchestra.run.gibba038.stdout: "long_desc": "", 2021-02-13T17:05:35.299 INFO:teuthology.orchestra.run.gibba038.stdout: "tags": [], 2021-02-13T17:05:35.299 INFO:teuthology.orchestra.run.gibba038.stdout: "see_also": [] 2021-02-13T17:05:35.299 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.299 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.299 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.300 INFO:teuthology.orchestra.run.gibba038.stdout: ], 2021-02-13T17:05:35.300 INFO:teuthology.orchestra.run.gibba038.stdout: "services": {}, 2021-02-13T17:05:35.300 INFO:teuthology.orchestra.run.gibba038.stdout: "always_on_modules": { 2021-02-13T17:05:35.300 INFO:teuthology.orchestra.run.gibba038.stdout: "nautilus": [ 2021-02-13T17:05:35.300 INFO:teuthology.orchestra.run.gibba038.stdout: "balancer", 2021-02-13T17:05:35.300 INFO:teuthology.orchestra.run.gibba038.stdout: "crash", 2021-02-13T17:05:35.300 INFO:teuthology.orchestra.run.gibba038.stdout: "devicehealth", 2021-02-13T17:05:35.300 INFO:teuthology.orchestra.run.gibba038.stdout: "orchestrator_cli", 2021-02-13T17:05:35.300 INFO:teuthology.orchestra.run.gibba038.stdout: "progress", 2021-02-13T17:05:35.300 INFO:teuthology.orchestra.run.gibba038.stdout: "rbd_support", 2021-02-13T17:05:35.300 INFO:teuthology.orchestra.run.gibba038.stdout: "status", 2021-02-13T17:05:35.300 INFO:teuthology.orchestra.run.gibba038.stdout: "volumes" 2021-02-13T17:05:35.300 INFO:teuthology.orchestra.run.gibba038.stdout: ] 2021-02-13T17:05:35.301 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-02-13T17:05:35.301 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.301 INFO:teuthology.orchestra.run.gibba038.stdout: "servicemap": { 2021-02-13T17:05:35.301 INFO:teuthology.orchestra.run.gibba038.stdout: "epoch": 1, 2021-02-13T17:05:35.301 INFO:teuthology.orchestra.run.gibba038.stdout: "modified": "0.000000", 2021-02-13T17:05:35.301 INFO:teuthology.orchestra.run.gibba038.stdout: "services": {} 2021-02-13T17:05:35.301 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-02-13T17:05:35.301 INFO:teuthology.orchestra.run.gibba038.stdout: "progress_events": {} 2021-02-13T17:05:35.301 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-02-13T17:05:35.303 INFO:tasks.ceph.ceph_manager.c2:{'fsid': '9862e2e1-3629-4a37-b410-fe5ad22a1229', 'health': {'checks': {}, 'status': 'HEALTH_OK'}, 'election_epoch': 3, 'quorum': [0], 'quorum_names': ['a'], 'quorum_age': 13, 'monmap': {'epoch': 1, 'min_mon_release_name': '14', 'num_mons': 1}, 'osdmap': {'osdmap': {'epoch': 11, 'num_osds': 3, 'num_up_osds': 3, 'num_in_osds': 3, 'num_remapped_pgs': 0}}, 'pgmap': {'pgs_by_state': [{'state_name': 'active+clean', 'count': 8}], 'num_pgs': 8, 'num_pools': 1, 'num_objects': 0, 'data_bytes': 0, 'bytes_used': 3221520384, 'bytes_avail': 318901026816, 'bytes_total': 322122547200}, 'fsmap': {'epoch': 1, 'by_rank': [], 'up:standby': 0}, 'mgrmap': {'epoch': 3, 'active_gid': 4100, 'active_name': 'x', 'active_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.138:6824', 'nonce': 14022}, {'type': 'v1', 'addr': '172.21.2.138:6825', 'nonce': 14022}]}, 'active_addr': '172.21.2.138:6825/14022', 'active_change': '2021-02-13 17:05:23.476237', 'available': True, 'standbys': [], 'modules': ['iostat', 'restful'], 'available_modules': [{'name': 'alerts', 'can_run': True, 'error_string': '', 'module_options': {'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'How frequently to reexamine health status', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_destination': {'name': 'smtp_destination', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email address to send alerts to', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_from_name': {'name': 'smtp_from_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'Ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email From: name', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_host': {'name': 'smtp_host', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_password': {'name': 'smtp_password', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Password to authenticate with', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_port': {'name': 'smtp_port', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '465', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP port', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_sender': {'name': 'smtp_sender', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP envelope sender', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_ssl': {'name': 'smtp_ssl', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Use SSL to connect to SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_user': {'name': 'smtp_user', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'User to authenticate as', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ansible', 'can_run': True, 'error_string': '', 'module_options': {'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_url': {'name': 'server_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_server': {'name': 'verify_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'balancer', 'can_run': True, 'error_string': '', 'module_options': {'active': {'name': 'active', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically balance PGs across cluster', 'long_desc': '', 'tags': [], 'see_also': []}, 'begin_time': {'name': 'begin_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '0000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'beginning time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'begin_weekday': {'name': 'begin_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to this day of the week or later', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'crush_compat_max_iterations': {'name': 'crush_compat_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '25', 'min': '1', 'max': '250', 'enum_allowed': [], 'desc': 'maximum number of iterations to attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'crush_compat_metrics': {'name': 'crush_compat_metrics', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'pgs,objects,bytes', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'metrics with which to calculate OSD utilization', 'long_desc': 'Value is a list of one or more of "pgs", "objects", or "bytes", and indicates which metrics to use to balance utilization.', 'tags': [], 'see_also': []}, 'crush_compat_step': {'name': 'crush_compat_step', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0.5', 'min': '0.001', 'max': '0.999', 'enum_allowed': [], 'desc': 'aggressiveness of optimization', 'long_desc': '.99 is very aggressive, .01 is less aggressive', 'tags': [], 'see_also': []}, 'end_time': {'name': 'end_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '2400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'ending time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'end_weekday': {'name': 'end_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '7', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to days of the week earlier than this', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'min_score': {'name': 'min_score', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'minimum score, below which no optimization is attempted', 'long_desc': '', 'tags': [], 'see_also': []}, 'mode': {'name': 'mode', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'none', 'min': '', 'max': '', 'enum_allowed': ['crush-compat', 'none', 'upmap'], 'desc': 'Balancer mode', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_ids': {'name': 'pool_ids', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'pools which the automatic balancing will be limited to', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'upmap_max_deviation': {'name': 'upmap_max_deviation', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '1', 'max': '', 'enum_allowed': [], 'desc': 'deviation below which no optimization is attempted', 'long_desc': 'If the number of PGs are within this count then no optimization is attempted', 'tags': [], 'see_also': []}, 'upmap_max_iterations': {'name': 'upmap_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '10', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'maximum upmap optimization iterations', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'crash', 'can_run': True, 'error_string': '', 'module_options': {'retain_interval': {'name': 'retain_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '31536000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain crashes before pruning them', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_recent_interval': {'name': 'warn_recent_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '1209600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'time interval in which to warn about recent crashes', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'dashboard', 'can_run': True, 'error_string': '', 'module_options': {'ALERTMANAGER_API_HOST': {'name': 'ALERTMANAGER_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_ENABLED': {'name': 'AUDIT_API_ENABLED', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_LOG_PAYLOAD': {'name': 'AUDIT_API_LOG_PAYLOAD', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ENABLE_BROWSABLE_API': {'name': 'ENABLE_BROWSABLE_API', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_cephfs': {'name': 'FEATURE_TOGGLE_cephfs', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_iscsi': {'name': 'FEATURE_TOGGLE_iscsi', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_mirroring': {'name': 'FEATURE_TOGGLE_mirroring', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rbd': {'name': 'FEATURE_TOGGLE_rbd', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rgw': {'name': 'FEATURE_TOGGLE_rgw', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE': {'name': 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_PASSWORD': {'name': 'GRAFANA_API_PASSWORD', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_SSL_VERIFY': {'name': 'GRAFANA_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_URL': {'name': 'GRAFANA_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_USERNAME': {'name': 'GRAFANA_API_USERNAME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_FRONTEND_API_URL': {'name': 'GRAFANA_FRONTEND_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_UPDATE_DASHBOARDS': {'name': 'GRAFANA_UPDATE_DASHBOARDS', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ISCSI_API_SSL_VERIFICATION': {'name': 'ISCSI_API_SSL_VERIFICATION', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'PROMETHEUS_API_HOST': {'name': 'PROMETHEUS_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'REST_REQUESTS_TIMEOUT': {'name': 'REST_REQUESTS_TIMEOUT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '45', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ACCESS_KEY': {'name': 'RGW_API_ACCESS_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ADMIN_RESOURCE': {'name': 'RGW_API_ADMIN_RESOURCE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_HOST': {'name': 'RGW_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_PORT': {'name': 'RGW_API_PORT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '80', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SCHEME': {'name': 'RGW_API_SCHEME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'http', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SECRET_KEY': {'name': 'RGW_API_SECRET_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SSL_VERIFY': {'name': 'RGW_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_USER_ID': {'name': 'RGW_API_USER_ID', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'crt_file': {'name': 'crt_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'debug': {'name': 'debug', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Enable/disable debug options', 'long_desc': '', 'tags': [], 'see_also': []}, 'jwt_token_ttl': {'name': 'jwt_token_ttl', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '28800', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '::', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8080', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl_server_port': {'name': 'ssl_server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8443', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_behaviour': {'name': 'standby_behaviour', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'redirect', 'min': '', 'max': '', 'enum_allowed': ['error', 'redirect'], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_error_status_code': {'name': 'standby_error_status_code', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '500', 'min': '400', 'max': '599', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url_prefix': {'name': 'url_prefix', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'deepsea', 'can_run': True, 'error_string': '', 'module_options': {'salt_api_eauth': {'name': 'salt_api_eauth', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'sharedsecret', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_password': {'name': 'salt_api_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_url': {'name': 'salt_api_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_username': {'name': 'salt_api_username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'devicehealth', 'can_run': True, 'error_string': '', 'module_options': {'enable_monitoring': {'name': 'enable_monitoring', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'monitor device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'mark_out_threshold': {'name': 'mark_out_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '2419200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically mark OSD if it may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_name': {'name': 'pool_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'device_health_metrics', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name of pool in which to store device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'retention_period': {'name': 'retention_period', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '15552000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_frequency': {'name': 'scrape_frequency', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to scrape device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'self_heal': {'name': 'self_heal', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'preemptively heal cluster around devices that may fail', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and check device health', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_threshold': {'name': 'warn_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '7257600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'raise health warning if OSD may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_cloud', 'can_run': True, 'error_string': '', 'module_options': {'diskprediction_cert_context': {'name': 'diskprediction_cert_context', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_default_authority': {'name': 'diskprediction_default_authority', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_password': {'name': 'diskprediction_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_port': {'name': 'diskprediction_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '31400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_retrieve_prediction_interval': {'name': 'diskprediction_retrieve_prediction_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_server': {'name': 'diskprediction_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_ssl_target_name_override': {'name': 'diskprediction_ssl_target_name_override', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_metrics_interval': {'name': 'diskprediction_upload_metrics_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_smart_interval': {'name': 'diskprediction_upload_smart_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_user': {'name': 'diskprediction_user', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_local', 'can_run': True, 'error_string': '', 'module_options': {'predict_interval': {'name': 'predict_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'influx', 'can_run': False, 'error_string': 'influxdb python module not found', 'module_options': {'batch_size': {'name': 'batch_size', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'database': {'name': 'database', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'hostname': {'name': 'hostname', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '30', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'port': {'name': 'port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '8086', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'false', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'threads': {'name': 'threads', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_ssl': {'name': 'verify_ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'true', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'insights', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'iostat', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'localpool', 'can_run': True, 'error_string': '', 'module_options': {'failure_domain': {'name': 'failure_domain', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'host', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'failure domain for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'min_size': {'name': 'min_size', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default min_size for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'num_rep': {'name': 'num_rep', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '3', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default replica count for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'pg_num': {'name': 'pg_num', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '128', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default pg_num for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'prefix': {'name': 'prefix', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name prefix for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'subtree': {'name': 'subtree', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'rack', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'CRUSH level for which to create a local pool', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'orchestrator_cli', 'can_run': True, 'error_string': '', 'module_options': {'orchestrator': {'name': 'orchestrator', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'pg_autoscaler', 'can_run': True, 'error_string': '', 'module_options': {'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'progress', 'can_run': True, 'error_string': '', 'module_options': {'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'max_completed_events': {'name': 'max_completed_events', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '50', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'number of past completed events to remember', 'long_desc': '', 'tags': [], 'see_also': []}, 'persist_interval': {'name': 'persist_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to persist completed events', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'prometheus', 'can_run': True, 'error_string': '', 'module_options': {'rbd_stats_pools': {'name': 'rbd_stats_pools', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rbd_stats_pools_refresh_interval': {'name': 'rbd_stats_pools_refresh_interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '300', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_interval': {'name': 'scrape_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'stale_cache_strategy': {'name': 'stale_cache_strategy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rbd_support', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'restful', 'can_run': True, 'error_string': '', 'module_options': {'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rook', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'selftest', 'can_run': True, 'error_string': '', 'module_options': {'roption1': {'name': 'roption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'roption2': {'name': 'roption2', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'xyz', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption1': {'name': 'rwoption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption2': {'name': 'rwoption2', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption3': {'name': 'rwoption3', 'type': 'float', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption4': {'name': 'rwoption4', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption5': {'name': 'rwoption5', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption6': {'name': 'rwoption6', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testkey': {'name': 'testkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testlkey': {'name': 'testlkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testnewline': {'name': 'testnewline', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ssh', 'can_run': True, 'error_string': '', 'module_options': {'inventory_cache_timeout_min': {'name': 'inventory_cache_timeout_min', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssh_config_file': {'name': 'ssh_config_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'status', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'telegraf', 'can_run': True, 'error_string': '', 'module_options': {'address': {'name': 'address', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'unixgram:///tmp/telegraf.sock', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '15', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'telemetry', 'can_run': True, 'error_string': '', 'module_options': {'channel_basic': {'name': 'channel_basic', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Share basic cluster information (size, version)', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_crash': {'name': 'channel_crash', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_device': {'name': 'channel_device', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_ident': {'name': 'channel_ident', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'contact': {'name': 'contact', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'description': {'name': 'description', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'device_url': {'name': 'device_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/device', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '24', 'min': '8', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'last_opt_revision': {'name': 'last_opt_revision', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '1', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'leaderboard': {'name': 'leaderboard', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'organization': {'name': 'organization', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'proxy': {'name': 'proxy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url': {'name': 'url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/report', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'test_orchestrator', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'volumes', 'can_run': True, 'error_string': '', 'module_options': {'max_concurrent_clones': {'name': 'max_concurrent_clones', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '4', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Number of asynchronous cloner threads', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'zabbix', 'can_run': True, 'error_string': '', 'module_options': {'identifier': {'name': 'identifier', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_host': {'name': 'zabbix_host', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_port': {'name': 'zabbix_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '10051', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_sender': {'name': 'zabbix_sender', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '/usr/bin/zabbix_sender', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}], 'services': {}, 'always_on_modules': {'nautilus': ['balancer', 'crash', 'devicehealth', 'orchestrator_cli', 'progress', 'rbd_support', 'status', 'volumes']}}, 'servicemap': {'epoch': 1, 'modified': '0.000000', 'services': {}}, 'progress_events': {}} 2021-02-13T17:05:35.304 INFO:tasks.ceph.ceph_manager.c2:clean! 2021-02-13T17:05:35.304 INFO:tasks.ceph:Waiting until ceph cluster c2 is healthy... 2021-02-13T17:05:35.305 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 health 2021-02-13T17:05:35.459 INFO:teuthology.misc.health.gibba038.stdout:HEALTH_OK 2021-02-13T17:05:35.467 DEBUG:teuthology.misc:Ceph health: HEALTH_OK 2021-02-13T17:05:35.467 INFO:teuthology.run_tasks:Running task rgw... 2021-02-13T17:05:35.481 DEBUG:tasks.rgw:config is {'c1.client.0': {'port': 8000}, 'c1.client.1': {'port': 8001}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}} 2021-02-13T17:05:35.481 DEBUG:tasks.rgw:client list is dict_keys(['c1.client.0', 'c1.client.1', 'c2.client.0', 'c2.client.1']) 2021-02-13T17:05:35.481 INFO:tasks.rgw:Creating data pools 2021-02-13T17:05:35.482 DEBUG:tasks.rgw:Obtaining remote for client c1.client.0 2021-02-13T17:05:35.482 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c1 2021-02-13T17:05:35.655 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'default.rgw.buckets.data' created 2021-02-13T17:05:35.662 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c1 2021-02-13T17:05:36.683 INFO:teuthology.orchestra.run.gibba037.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-02-13T17:05:36.689 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c1 2021-02-13T17:05:37.711 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'default.rgw.buckets.index' created 2021-02-13T17:05:37.724 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c1 2021-02-13T17:05:38.699 INFO:teuthology.orchestra.run.gibba037.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-02-13T17:05:38.708 DEBUG:tasks.rgw:Obtaining remote for client c1.client.1 2021-02-13T17:05:38.708 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c1 2021-02-13T17:05:38.866 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'default.rgw.buckets.data' already exists 2021-02-13T17:05:38.874 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c1 2021-02-13T17:05:39.695 INFO:teuthology.orchestra.run.gibba037.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-02-13T17:05:39.702 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c1 2021-02-13T17:05:39.862 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'default.rgw.buckets.index' already exists 2021-02-13T17:05:39.871 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c1 2021-02-13T17:05:40.691 INFO:teuthology.orchestra.run.gibba037.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-02-13T17:05:40.698 DEBUG:tasks.rgw:Obtaining remote for client c2.client.0 2021-02-13T17:05:40.699 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2021-02-13T17:05:40.922 INFO:teuthology.orchestra.run.gibba038.stderr:pool 'default.rgw.buckets.data' created 2021-02-13T17:05:40.929 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2021-02-13T17:05:41.950 INFO:teuthology.orchestra.run.gibba038.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-02-13T17:05:41.959 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2021-02-13T17:05:42.968 INFO:teuthology.orchestra.run.gibba038.stderr:pool 'default.rgw.buckets.index' created 2021-02-13T17:05:42.980 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2021-02-13T17:05:43.950 INFO:teuthology.orchestra.run.gibba038.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-02-13T17:05:43.958 DEBUG:tasks.rgw:Obtaining remote for client c2.client.1 2021-02-13T17:05:43.959 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2021-02-13T17:05:44.113 INFO:teuthology.orchestra.run.gibba038.stderr:pool 'default.rgw.buckets.data' already exists 2021-02-13T17:05:44.121 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2021-02-13T17:05:44.989 INFO:teuthology.orchestra.run.gibba038.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-02-13T17:05:45.001 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2021-02-13T17:05:45.156 INFO:teuthology.orchestra.run.gibba038.stderr:pool 'default.rgw.buckets.index' already exists 2021-02-13T17:05:45.164 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2021-02-13T17:05:45.993 INFO:teuthology.orchestra.run.gibba038.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-02-13T17:05:46.006 DEBUG:tasks.rgw:Pools created 2021-02-13T17:05:46.006 INFO:tasks.rgw:Configuring compression type = random 2021-02-13T17:05:46.006 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'list'] 2021-02-13T17:05:46.006 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'list'] 2021-02-13T17:05:46.006 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user list 2021-02-13T17:05:46.041 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:46.033 7fdcef1bc940 20 rados->read ofs=0 len=0 2021-02-13T17:05:47.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.101 7fdcef1bc940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:47.108 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.101 7fdcef1bc940 20 rados->read ofs=0 len=0 2021-02-13T17:05:47.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.101 7fdcef1bc940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:47.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.101 7fdcef1bc940 20 rados->read ofs=0 len=0 2021-02-13T17:05:47.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.101 7fdcef1bc940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:47.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.101 7fdcef1bc940 20 rados->read ofs=0 len=0 2021-02-13T17:05:47.110 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.101 7fdcef1bc940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:47.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.113 7fdcef1bc940 20 rados->read ofs=0 len=0 2021-02-13T17:05:47.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.113 7fdcef1bc940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:47.119 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.113 7fdcef1bc940 20 rados->read ofs=0 len=0 2021-02-13T17:05:47.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.113 7fdcef1bc940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:47.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.113 7fdcef1bc940 20 rados->read ofs=0 len=0 2021-02-13T17:05:47.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.113 7fdcef1bc940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:47.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.113 7fdcef1bc940 10 cannot find current period zonegroup using local zonegroup 2021-02-13T17:05:47.120 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.113 7fdcef1bc940 20 rados->read ofs=0 len=0 2021-02-13T17:05:47.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.113 7fdcef1bc940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:47.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.113 7fdcef1bc940 20 rados->read ofs=0 len=0 2021-02-13T17:05:47.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.113 7fdcef1bc940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:47.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.113 7fdcef1bc940 10 Creating default zonegroup 2021-02-13T17:05:47.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.113 7fdcef1bc940 20 get_system_obj_state: rctx=0x7ffc179d10b0 obj=:.pools.avail state=0x562d013b6e70 s->prefetch_data=0 2021-02-13T17:05:47.121 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.113 7fdcef1bc940 10 couldn't find old data placement pools config, setting up new ones for the zone 2021-02-13T17:05:47.128 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.121 7fdcef1bc940 10 WARNING: store->list_zones() returned r=-2 2021-02-13T17:05:47.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.121 7fdcef1bc940 20 rados->read ofs=0 len=0 2021-02-13T17:05:47.129 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.121 7fdcef1bc940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:47.132 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.125 7fdcef1bc940 20 rados->read ofs=0 len=0 2021-02-13T17:05:47.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.125 7fdcef1bc940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:47.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.125 7fdcef1bc940 10 could not read realm id: (2) No such file or directory 2021-02-13T17:05:47.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.125 7fdcef1bc940 10 WARNING: failed to set zone as default, r=-22 2021-02-13T17:05:47.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.125 7fdcef1bc940 20 rados->read ofs=0 len=0 2021-02-13T17:05:47.133 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.125 7fdcef1bc940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:47.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.129 7fdcef1bc940 20 rados->read ofs=0 len=0 2021-02-13T17:05:47.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.129 7fdcef1bc940 20 rados_obj.operate() r=0 bl.length=805 2021-02-13T17:05:47.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.129 7fdcef1bc940 20 rados->read ofs=0 len=0 2021-02-13T17:05:47.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.129 7fdcef1bc940 20 rados_obj.operate() r=0 bl.length=348 2021-02-13T17:05:47.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.129 7fdcef1bc940 20 zonegroup default 2021-02-13T17:05:47.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.129 7fdcef1bc940 20 rados->read ofs=0 len=0 2021-02-13T17:05:47.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.129 7fdcef1bc940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:47.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.129 7fdcef1bc940 10 Cannot find current period zone using local zone 2021-02-13T17:05:47.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.129 7fdcef1bc940 10 Using default name default 2021-02-13T17:05:47.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.129 7fdcef1bc940 20 rados->read ofs=0 len=0 2021-02-13T17:05:47.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.133 7fdcef1bc940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:05:47.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.133 7fdcef1bc940 20 rados->read ofs=0 len=0 2021-02-13T17:05:47.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.133 7fdcef1bc940 20 rados_obj.operate() r=0 bl.length=805 2021-02-13T17:05:47.139 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:47.133 7fdcef1bc940 20 zone default 2021-02-13T17:05:49.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:49.129 7fdcef1bc940 20 add_watcher() i=0 2021-02-13T17:05:49.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:49.129 7fdcef1bc940 20 add_watcher() i=1 2021-02-13T17:05:49.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:49.129 7fdcef1bc940 20 add_watcher() i=2 2021-02-13T17:05:49.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:49.129 7fdcef1bc940 20 add_watcher() i=3 2021-02-13T17:05:49.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:49.129 7fdcef1bc940 20 add_watcher() i=4 2021-02-13T17:05:49.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:49.129 7fdcef1bc940 20 add_watcher() i=5 2021-02-13T17:05:49.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:49.129 7fdcef1bc940 20 add_watcher() i=6 2021-02-13T17:05:49.135 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:49.129 7fdcef1bc940 20 add_watcher() i=7 2021-02-13T17:05:49.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:49.129 7fdcef1bc940 2 all 8 watchers are set, enabling cache 2021-02-13T17:05:49.138 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:49.129 7fdcaaffd700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-02-13T17:05:51.136 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:51.129 7fdcef1bc940 10 rgw_init_ioctx warning: failed to set pg_autoscale_bias on default.rgw.meta 2021-02-13T17:05:51.137 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:51.129 7fdcef1bc940 10 rgw_init_ioctx warning: failed to set pg_num_min on default.rgw.meta 2021-02-13T17:05:53.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.145 7fdcef1bc940 10 rgw_init_ioctx warning: failed to set pg_autoscale_bias on default.rgw.log 2021-02-13T17:05:53.153 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.145 7fdcef1bc940 10 rgw_init_ioctx warning: failed to set pg_num_min on default.rgw.log 2021-02-13T17:05:53.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.157 7fdc8d7e2700 20 reqs_thread_entry: start 2021-02-13T17:05:53.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.157 7fdc06ffd700 20 reqs_thread_entry: start 2021-02-13T17:05:53.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.157 7fdcef1bc940 20 init_complete bucket index max shards: 0 2021-02-13T17:05:53.164 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.157 7fdc057fa700 20 reqs_thread_entry: start 2021-02-13T17:05:53.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.169 7fdcef1bc940 20 remove_watcher() i=0 2021-02-13T17:05:53.177 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.169 7fdcef1bc940 2 removed watcher, disabling cache 2021-02-13T17:05:53.178 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.169 7fdcef1bc940 20 remove_watcher() i=1 2021-02-13T17:05:53.179 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.173 7fdcef1bc940 20 remove_watcher() i=2 2021-02-13T17:05:53.181 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.173 7fdcef1bc940 20 remove_watcher() i=3 2021-02-13T17:05:53.182 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.177 7fdcef1bc940 20 remove_watcher() i=4 2021-02-13T17:05:53.183 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.177 7fdcef1bc940 20 remove_watcher() i=5 2021-02-13T17:05:53.184 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.177 7fdcef1bc940 20 remove_watcher() i=6 2021-02-13T17:05:53.185 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.177 7fdcef1bc940 20 remove_watcher() i=7 2021-02-13T17:05:53.188 INFO:teuthology.orchestra.run.gibba037.stdout:[] 2021-02-13T17:05:53.188 DEBUG:tasks.util.rgw: json result: [] 2021-02-13T17:05:53.188 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-02-13T17:05:53.188 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-02-13T17:05:53.189 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-02-13T17:05:53.302 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.293 7f6e93fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-02-13T17:05:53.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.297 7f6e937fe700 20 reqs_thread_entry: start 2021-02-13T17:05:53.303 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.297 7f6ecffb5940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.297 7f6ecffb5940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:05:53.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.297 7f6ecffb5940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.297 7f6ecffb5940 20 rados_obj.operate() r=0 bl.length=805 2021-02-13T17:05:53.304 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.297 7f6ecffb5940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.297 7f6ecffb5940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:53.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.297 7f6ecffb5940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.297 7f6ecffb5940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:05:53.305 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.297 7f6ecffb5940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.306 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.297 7f6ecffb5940 20 rados_obj.operate() r=0 bl.length=348 2021-02-13T17:05:53.311 INFO:teuthology.orchestra.run.gibba037.stdout:{"id":"f4d95934-b16c-4b79-9b5b-50e62efcbfef","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":""} 2021-02-13T17:05:53.311 DEBUG:tasks.util.rgw: json result: {'id': 'f4d95934-b16c-4b79-9b5b-50e62efcbfef', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'metadata_heap': '', 'realm_id': ''} 2021-02-13T17:05:53.311 INFO:tasks.util.rgw:rgwadmin: c1.client.1 : ['user', 'list'] 2021-02-13T17:05:53.311 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c1', 'user', 'list'] 2021-02-13T17:05:53.311 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c1 user list 2021-02-13T17:05:53.333 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.325 7f63308f3940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.325 7f63308f3940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:53.334 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.325 7f63308f3940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.329 7f63308f3940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:53.335 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.329 7f63308f3940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.329 7f63308f3940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:53.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.329 7f63308f3940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.336 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.329 7f63308f3940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:05:53.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.337 7f63308f3940 20 RGWRados::pool_iterate: got zonegroup_info.c78ec041-1afe-4abc-aa32-48fc45b9fab7 2021-02-13T17:05:53.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.337 7f63308f3940 20 RGWRados::pool_iterate: got zone_info.f4d95934-b16c-4b79-9b5b-50e62efcbfef 2021-02-13T17:05:53.346 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.337 7f63308f3940 20 RGWRados::pool_iterate: got zone_names.default 2021-02-13T17:05:53.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.337 7f63308f3940 20 RGWRados::pool_iterate: got zonegroups_names.default 2021-02-13T17:05:53.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.337 7f63308f3940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:05:53.347 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados_obj.operate() r=0 bl.length=821 2021-02-13T17:05:53.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:05:53.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados_obj.operate() r=0 bl.length=348 2021-02-13T17:05:53.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:53.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 10 cannot find current period zonegroup using local zonegroup 2021-02-13T17:05:53.348 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:53.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:05:53.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.350 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados_obj.operate() r=0 bl.length=348 2021-02-13T17:05:53.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 zonegroup default 2021-02-13T17:05:53.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:53.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 10 Cannot find current period zone using local zone 2021-02-13T17:05:53.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:53.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:05:53.351 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.341 7f63308f3940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.345 7f63308f3940 20 rados_obj.operate() r=0 bl.length=821 2021-02-13T17:05:53.352 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.345 7f63308f3940 20 zone default 2021-02-13T17:05:53.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.353 7f63308f3940 20 add_watcher() i=0 2021-02-13T17:05:53.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.353 7f63308f3940 20 add_watcher() i=1 2021-02-13T17:05:53.360 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.353 7f63308f3940 20 add_watcher() i=2 2021-02-13T17:05:53.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.353 7f63308f3940 20 add_watcher() i=3 2021-02-13T17:05:53.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.353 7f63308f3940 20 add_watcher() i=4 2021-02-13T17:05:53.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.353 7f63308f3940 20 add_watcher() i=5 2021-02-13T17:05:53.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.353 7f63308f3940 20 add_watcher() i=6 2021-02-13T17:05:53.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.353 7f63308f3940 20 add_watcher() i=7 2021-02-13T17:05:53.361 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.353 7f63308f3940 2 all 8 watchers are set, enabling cache 2021-02-13T17:05:53.363 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.357 7f62f8ff9700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-02-13T17:05:53.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.357 7f62dbfdf700 20 reqs_thread_entry: start 2021-02-13T17:05:53.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.357 7f62d9fdb700 20 reqs_thread_entry: start 2021-02-13T17:05:53.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.357 7f63308f3940 20 init_complete bucket index max shards: 0 2021-02-13T17:05:53.364 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.357 7f62d37fe700 20 reqs_thread_entry: start 2021-02-13T17:05:53.375 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.369 7f63308f3940 20 remove_watcher() i=0 2021-02-13T17:05:53.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.369 7f63308f3940 2 removed watcher, disabling cache 2021-02-13T17:05:53.376 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.369 7f63308f3940 20 remove_watcher() i=1 2021-02-13T17:05:53.378 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.369 7f63308f3940 20 remove_watcher() i=2 2021-02-13T17:05:53.379 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.373 7f63308f3940 20 remove_watcher() i=3 2021-02-13T17:05:53.380 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.373 7f63308f3940 20 remove_watcher() i=4 2021-02-13T17:05:53.381 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.373 7f63308f3940 20 remove_watcher() i=5 2021-02-13T17:05:53.382 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.373 7f63308f3940 20 remove_watcher() i=6 2021-02-13T17:05:53.384 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.377 7f63308f3940 20 remove_watcher() i=7 2021-02-13T17:05:53.387 INFO:teuthology.orchestra.run.gibba037.stdout:[] 2021-02-13T17:05:53.387 DEBUG:tasks.util.rgw: json result: [] 2021-02-13T17:05:53.387 INFO:tasks.util.rgw:rgwadmin: c1.client.1 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-02-13T17:05:53.388 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c1', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-02-13T17:05:53.388 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c1 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-02-13T17:05:53.502 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.493 7f081effd700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-02-13T17:05:53.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.497 7f081e7fc700 20 reqs_thread_entry: start 2021-02-13T17:05:53.503 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.497 7f085b612940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.497 7f085b612940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:05:53.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.497 7f085b612940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.497 7f085b612940 20 rados_obj.operate() r=0 bl.length=821 2021-02-13T17:05:53.504 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.497 7f085b612940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.497 7f085b612940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:53.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.497 7f085b612940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.497 7f085b612940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:05:53.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.497 7f085b612940 20 rados->read ofs=0 len=0 2021-02-13T17:05:53.505 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:05:53.497 7f085b612940 20 rados_obj.operate() r=0 bl.length=348 2021-02-13T17:05:53.510 INFO:teuthology.orchestra.run.gibba037.stdout:{"id":"f4d95934-b16c-4b79-9b5b-50e62efcbfef","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":""} 2021-02-13T17:05:53.510 DEBUG:tasks.util.rgw: json result: {'id': 'f4d95934-b16c-4b79-9b5b-50e62efcbfef', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'metadata_heap': '', 'realm_id': ''} 2021-02-13T17:05:53.510 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['user', 'list'] 2021-02-13T17:05:53.510 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'user', 'list'] 2021-02-13T17:05:53.510 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 user list 2021-02-13T17:05:53.538 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:53.534 7f3ae0ad1940 20 rados->read ofs=0 len=0 2021-02-13T17:05:54.606 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.602 7f3ae0ad1940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:54.606 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.602 7f3ae0ad1940 20 rados->read ofs=0 len=0 2021-02-13T17:05:54.609 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.602 7f3ae0ad1940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:54.609 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.602 7f3ae0ad1940 20 rados->read ofs=0 len=0 2021-02-13T17:05:54.609 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.602 7f3ae0ad1940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:54.609 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.602 7f3ae0ad1940 20 rados->read ofs=0 len=0 2021-02-13T17:05:54.609 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.606 7f3ae0ad1940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:54.618 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.614 7f3ae0ad1940 20 rados->read ofs=0 len=0 2021-02-13T17:05:54.619 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.614 7f3ae0ad1940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:54.619 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.614 7f3ae0ad1940 20 rados->read ofs=0 len=0 2021-02-13T17:05:54.619 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.614 7f3ae0ad1940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:54.619 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.614 7f3ae0ad1940 20 rados->read ofs=0 len=0 2021-02-13T17:05:54.620 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.614 7f3ae0ad1940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:54.620 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.614 7f3ae0ad1940 10 cannot find current period zonegroup using local zonegroup 2021-02-13T17:05:54.620 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.614 7f3ae0ad1940 20 rados->read ofs=0 len=0 2021-02-13T17:05:54.620 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.614 7f3ae0ad1940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:54.620 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.614 7f3ae0ad1940 20 rados->read ofs=0 len=0 2021-02-13T17:05:54.620 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.614 7f3ae0ad1940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:54.620 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.614 7f3ae0ad1940 10 Creating default zonegroup 2021-02-13T17:05:54.620 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.614 7f3ae0ad1940 20 get_system_obj_state: rctx=0x7fff8a2f0e10 obj=:.pools.avail state=0x55adc0765e70 s->prefetch_data=0 2021-02-13T17:05:54.621 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.614 7f3ae0ad1940 10 couldn't find old data placement pools config, setting up new ones for the zone 2021-02-13T17:05:54.630 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.626 7f3ae0ad1940 10 WARNING: store->list_zones() returned r=-2 2021-02-13T17:05:54.630 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.626 7f3ae0ad1940 20 rados->read ofs=0 len=0 2021-02-13T17:05:54.630 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.626 7f3ae0ad1940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:54.633 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.630 7f3ae0ad1940 20 rados->read ofs=0 len=0 2021-02-13T17:05:54.634 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.630 7f3ae0ad1940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:54.634 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.630 7f3ae0ad1940 10 could not read realm id: (2) No such file or directory 2021-02-13T17:05:54.634 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.630 7f3ae0ad1940 10 WARNING: failed to set zone as default, r=-22 2021-02-13T17:05:54.634 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.630 7f3ae0ad1940 20 rados->read ofs=0 len=0 2021-02-13T17:05:54.634 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.630 7f3ae0ad1940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:54.636 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.630 7f3ae0ad1940 20 rados->read ofs=0 len=0 2021-02-13T17:05:54.637 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.630 7f3ae0ad1940 20 rados_obj.operate() r=0 bl.length=805 2021-02-13T17:05:54.637 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.630 7f3ae0ad1940 20 rados->read ofs=0 len=0 2021-02-13T17:05:54.637 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.634 7f3ae0ad1940 20 rados_obj.operate() r=0 bl.length=348 2021-02-13T17:05:54.637 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.634 7f3ae0ad1940 20 zonegroup default 2021-02-13T17:05:54.637 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.634 7f3ae0ad1940 20 rados->read ofs=0 len=0 2021-02-13T17:05:54.638 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.634 7f3ae0ad1940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:05:54.638 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.634 7f3ae0ad1940 10 Cannot find current period zone using local zone 2021-02-13T17:05:54.638 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.634 7f3ae0ad1940 10 Using default name default 2021-02-13T17:05:54.638 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.634 7f3ae0ad1940 20 rados->read ofs=0 len=0 2021-02-13T17:05:54.638 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.634 7f3ae0ad1940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:05:54.638 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.634 7f3ae0ad1940 20 rados->read ofs=0 len=0 2021-02-13T17:05:54.638 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.634 7f3ae0ad1940 20 rados_obj.operate() r=0 bl.length=805 2021-02-13T17:05:54.639 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:54.634 7f3ae0ad1940 20 zone default 2021-02-13T17:05:56.631 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:56.626 7f3ae0ad1940 20 add_watcher() i=0 2021-02-13T17:05:56.631 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:56.626 7f3ae0ad1940 20 add_watcher() i=1 2021-02-13T17:05:56.631 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:56.626 7f3ae0ad1940 20 add_watcher() i=2 2021-02-13T17:05:56.631 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:56.626 7f3ae0ad1940 20 add_watcher() i=3 2021-02-13T17:05:56.631 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:56.626 7f3ae0ad1940 20 add_watcher() i=4 2021-02-13T17:05:56.631 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:56.626 7f3ae0ad1940 20 add_watcher() i=5 2021-02-13T17:05:56.631 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:56.626 7f3ae0ad1940 20 add_watcher() i=6 2021-02-13T17:05:56.632 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:56.626 7f3ae0ad1940 20 add_watcher() i=7 2021-02-13T17:05:56.632 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:56.626 7f3ae0ad1940 2 all 8 watchers are set, enabling cache 2021-02-13T17:05:56.633 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:56.626 7f3aa8ff9700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-02-13T17:05:58.633 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:58.630 7f3ae0ad1940 10 rgw_init_ioctx warning: failed to set pg_autoscale_bias on default.rgw.meta 2021-02-13T17:05:58.634 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:05:58.630 7f3ae0ad1940 10 rgw_init_ioctx warning: failed to set pg_num_min on default.rgw.meta 2021-02-13T17:06:00.648 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.642 7f3ae0ad1940 10 rgw_init_ioctx warning: failed to set pg_autoscale_bias on default.rgw.log 2021-02-13T17:06:00.648 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.642 7f3ae0ad1940 10 rgw_init_ioctx warning: failed to set pg_num_min on default.rgw.log 2021-02-13T17:06:00.655 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.650 7f3a7f7de700 20 reqs_thread_entry: start 2021-02-13T17:06:00.655 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.650 7f3a7d7da700 20 reqs_thread_entry: start 2021-02-13T17:06:00.655 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.650 7f3ae0ad1940 20 init_complete bucket index max shards: 0 2021-02-13T17:06:00.655 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.650 7f39ef7fe700 20 reqs_thread_entry: start 2021-02-13T17:06:00.668 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.662 7f3ae0ad1940 20 remove_watcher() i=0 2021-02-13T17:06:00.668 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.662 7f3ae0ad1940 2 removed watcher, disabling cache 2021-02-13T17:06:00.669 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.662 7f3ae0ad1940 20 remove_watcher() i=1 2021-02-13T17:06:00.670 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.666 7f3ae0ad1940 20 remove_watcher() i=2 2021-02-13T17:06:00.672 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.666 7f3ae0ad1940 20 remove_watcher() i=3 2021-02-13T17:06:00.673 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.666 7f3ae0ad1940 20 remove_watcher() i=4 2021-02-13T17:06:00.674 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.670 7f3ae0ad1940 20 remove_watcher() i=5 2021-02-13T17:06:00.675 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.670 7f3ae0ad1940 20 remove_watcher() i=6 2021-02-13T17:06:00.677 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.670 7f3ae0ad1940 20 remove_watcher() i=7 2021-02-13T17:06:00.679 INFO:teuthology.orchestra.run.gibba038.stdout:[] 2021-02-13T17:06:00.680 DEBUG:tasks.util.rgw: json result: [] 2021-02-13T17:06:00.680 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-02-13T17:06:00.680 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-02-13T17:06:00.680 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-02-13T17:06:00.792 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.786 7ff35dffb700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-02-13T17:06:00.792 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.786 7ff35d7fa700 20 reqs_thread_entry: start 2021-02-13T17:06:00.792 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.786 7ff399f5e940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.793 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.786 7ff399f5e940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:06:00.793 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.786 7ff399f5e940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.794 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.790 7ff399f5e940 20 rados_obj.operate() r=0 bl.length=805 2021-02-13T17:06:00.794 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.790 7ff399f5e940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.794 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.790 7ff399f5e940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:06:00.795 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.790 7ff399f5e940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.795 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.790 7ff399f5e940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:06:00.795 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.790 7ff399f5e940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.796 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.790 7ff399f5e940 20 rados_obj.operate() r=0 bl.length=348 2021-02-13T17:06:00.800 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"fd96ebf8-e662-4358-972a-b38be6f26c20","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":""} 2021-02-13T17:06:00.801 DEBUG:tasks.util.rgw: json result: {'id': 'fd96ebf8-e662-4358-972a-b38be6f26c20', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'metadata_heap': '', 'realm_id': ''} 2021-02-13T17:06:00.801 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['user', 'list'] 2021-02-13T17:06:00.801 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'user', 'list'] 2021-02-13T17:06:00.801 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 user list 2021-02-13T17:06:00.824 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.818 7f131e927940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.825 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.818 7f131e927940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:06:00.825 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.818 7f131e927940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.826 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.822 7f131e927940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:06:00.826 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.822 7f131e927940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.826 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.822 7f131e927940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:06:00.826 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.822 7f131e927940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.826 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.822 7f131e927940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:06:00.837 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.830 7f131e927940 20 RGWRados::pool_iterate: got zone_info.fd96ebf8-e662-4358-972a-b38be6f26c20 2021-02-13T17:06:00.837 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.830 7f131e927940 20 RGWRados::pool_iterate: got zonegroup_info.46d50bfe-2caa-44df-abbd-97bf08f19f38 2021-02-13T17:06:00.837 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.830 7f131e927940 20 RGWRados::pool_iterate: got zone_names.default 2021-02-13T17:06:00.837 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.830 7f131e927940 20 RGWRados::pool_iterate: got zonegroups_names.default 2021-02-13T17:06:00.837 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.830 7f131e927940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.838 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:06:00.838 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.838 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados_obj.operate() r=0 bl.length=821 2021-02-13T17:06:00.838 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.839 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:06:00.839 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.839 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados_obj.operate() r=0 bl.length=348 2021-02-13T17:06:00.839 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.839 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:06:00.840 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 10 cannot find current period zonegroup using local zonegroup 2021-02-13T17:06:00.840 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.840 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:06:00.840 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.840 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:06:00.840 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.841 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados_obj.operate() r=0 bl.length=348 2021-02-13T17:06:00.841 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 zonegroup default 2021-02-13T17:06:00.841 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.841 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:06:00.841 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 10 Cannot find current period zone using local zone 2021-02-13T17:06:00.841 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.841 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:06:00.841 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.842 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:06:00.842 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.834 7f131e927940 20 rados->read ofs=0 len=0 2021-02-13T17:06:00.842 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.838 7f131e927940 20 rados_obj.operate() r=0 bl.length=821 2021-02-13T17:06:00.842 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.838 7f131e927940 20 zone default 2021-02-13T17:06:00.851 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.846 7f131e927940 20 add_watcher() i=0 2021-02-13T17:06:00.851 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.846 7f131e927940 20 add_watcher() i=1 2021-02-13T17:06:00.851 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.846 7f131e927940 20 add_watcher() i=2 2021-02-13T17:06:00.851 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.846 7f131e927940 20 add_watcher() i=3 2021-02-13T17:06:00.851 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.846 7f131e927940 20 add_watcher() i=4 2021-02-13T17:06:00.851 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.846 7f131e927940 20 add_watcher() i=5 2021-02-13T17:06:00.851 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.846 7f131e927940 20 add_watcher() i=6 2021-02-13T17:06:00.852 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.846 7f131e927940 20 add_watcher() i=7 2021-02-13T17:06:00.852 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.846 7f131e927940 2 all 8 watchers are set, enabling cache 2021-02-13T17:06:00.854 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.850 7f12e27fc700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-02-13T17:06:00.856 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.850 7f12c97e2700 20 reqs_thread_entry: start 2021-02-13T17:06:00.856 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.850 7f12c2ffd700 20 reqs_thread_entry: start 2021-02-13T17:06:00.856 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.850 7f131e927940 20 init_complete bucket index max shards: 0 2021-02-13T17:06:00.856 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.850 7f12c0fe1700 20 reqs_thread_entry: start 2021-02-13T17:06:00.870 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.866 7f131e927940 20 remove_watcher() i=0 2021-02-13T17:06:00.870 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.866 7f131e927940 2 removed watcher, disabling cache 2021-02-13T17:06:00.872 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.866 7f131e927940 20 remove_watcher() i=1 2021-02-13T17:06:00.873 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.870 7f131e927940 20 remove_watcher() i=2 2021-02-13T17:06:00.875 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.870 7f131e927940 20 remove_watcher() i=3 2021-02-13T17:06:00.876 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.870 7f131e927940 20 remove_watcher() i=4 2021-02-13T17:06:00.878 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.874 7f131e927940 20 remove_watcher() i=5 2021-02-13T17:06:00.879 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.874 7f131e927940 20 remove_watcher() i=6 2021-02-13T17:06:00.881 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.874 7f131e927940 20 remove_watcher() i=7 2021-02-13T17:06:00.885 INFO:teuthology.orchestra.run.gibba038.stdout:[] 2021-02-13T17:06:00.885 DEBUG:tasks.util.rgw: json result: [] 2021-02-13T17:06:00.885 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-02-13T17:06:00.885 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-02-13T17:06:00.886 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-02-13T17:06:01.001 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.994 7f6ab7fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-02-13T17:06:01.001 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.998 7f6af41f3940 20 rados->read ofs=0 len=0 2021-02-13T17:06:01.002 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.998 7f6ab77fe700 20 reqs_thread_entry: start 2021-02-13T17:06:01.002 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.998 7f6af41f3940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:06:01.002 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.998 7f6af41f3940 20 rados->read ofs=0 len=0 2021-02-13T17:06:01.003 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.998 7f6af41f3940 20 rados_obj.operate() r=0 bl.length=821 2021-02-13T17:06:01.003 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.998 7f6af41f3940 20 rados->read ofs=0 len=0 2021-02-13T17:06:01.003 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.998 7f6af41f3940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:06:01.003 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.998 7f6af41f3940 20 rados->read ofs=0 len=0 2021-02-13T17:06:01.004 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.998 7f6af41f3940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:06:01.004 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.998 7f6af41f3940 20 rados->read ofs=0 len=0 2021-02-13T17:06:01.004 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:00.998 7f6af41f3940 20 rados_obj.operate() r=0 bl.length=348 2021-02-13T17:06:01.009 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"fd96ebf8-e662-4358-972a-b38be6f26c20","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":""} 2021-02-13T17:06:01.009 DEBUG:tasks.util.rgw: json result: {'id': 'fd96ebf8-e662-4358-972a-b38be6f26c20', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'metadata_heap': '', 'realm_id': ''} 2021-02-13T17:06:01.010 INFO:tasks.rgw:Starting rgw... 2021-02-13T17:06:01.010 INFO:tasks.rgw:rgw c1.client.0 config is {'port': 8000} 2021-02-13T17:06:01.010 INFO:tasks.rgw:Using beast as radosgw frontend 2021-02-13T17:06:01.010 INFO:tasks.rgw.c1.client.0:Restarting daemon 2021-02-13T17:06:01.010 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2021-02-13T17:06:01.013 INFO:tasks.rgw.c1.client.0:Started 2021-02-13T17:06:01.013 INFO:tasks.rgw:rgw c1.client.1 config is {'port': 8001} 2021-02-13T17:06:01.013 INFO:tasks.rgw:Using beast as radosgw frontend 2021-02-13T17:06:01.013 INFO:tasks.rgw.c1.client.1:Restarting daemon 2021-02-13T17:06:01.013 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground | sudo tee /var/log/ceph/rgw.c1.client.1.stdout 2>&1 2021-02-13T17:06:01.015 INFO:tasks.rgw.c1.client.1:Started 2021-02-13T17:06:01.015 INFO:tasks.rgw:rgw c2.client.0 config is {'port': 8000} 2021-02-13T17:06:01.015 INFO:tasks.rgw:Using beast as radosgw frontend 2021-02-13T17:06:01.016 INFO:tasks.rgw.c2.client.0:Restarting daemon 2021-02-13T17:06:01.016 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2021-02-13T17:06:01.017 INFO:tasks.rgw.c2.client.0:Started 2021-02-13T17:06:01.017 INFO:tasks.rgw:rgw c2.client.1 config is {'port': 8001} 2021-02-13T17:06:01.018 INFO:tasks.rgw:Using beast as radosgw frontend 2021-02-13T17:06:01.018 INFO:tasks.rgw.c2.client.1:Restarting daemon 2021-02-13T17:06:01.018 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2021-02-13T17:06:01.019 INFO:tasks.rgw.c2.client.1:Started 2021-02-13T17:06:01.019 INFO:tasks.rgw:Polling c1.client.0 until it starts accepting connections on http://gibba037.front.sepia.ceph.com:8000/ 2021-02-13T17:06:01.019 DEBUG:teuthology.orchestra.run.gibba037:> curl http://gibba037.front.sepia.ceph.com:8000/ 2021-02-13T17:06:01.037 INFO:teuthology.orchestra.run.gibba037.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:06:01.037 INFO:teuthology.orchestra.run.gibba037.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:06:01.041 INFO:teuthology.orchestra.run.gibba037.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to gibba037.front.sepia.ceph.com port 8000: Connection refused 2021-02-13T17:06:01.042 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-02-13T17:06:02.043 DEBUG:teuthology.orchestra.run.gibba037:> curl http://gibba037.front.sepia.ceph.com:8000/ 2021-02-13T17:06:02.054 INFO:teuthology.orchestra.run.gibba037.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:06:02.055 INFO:teuthology.orchestra.run.gibba037.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:06:02.060 INFO:teuthology.orchestra.run.gibba037.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 42800 2021-02-13T17:06:02.061 INFO:teuthology.orchestra.run.gibba037.stdout:anonymous 2021-02-13T17:06:02.061 INFO:tasks.rgw:Polling c1.client.1 until it starts accepting connections on http://gibba037.front.sepia.ceph.com:8001/ 2021-02-13T17:06:02.061 DEBUG:teuthology.orchestra.run.gibba037:> curl http://gibba037.front.sepia.ceph.com:8001/ 2021-02-13T17:06:02.111 INFO:teuthology.orchestra.run.gibba037.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:06:02.111 INFO:teuthology.orchestra.run.gibba037.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:06:02.116 INFO:teuthology.orchestra.run.gibba037.stdout:anonymous 2021-02-13T17:06:02.117 INFO:teuthology.orchestra.run.gibba037.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 42800 2021-02-13T17:06:02.117 INFO:tasks.rgw:Polling c2.client.0 until it starts accepting connections on http://gibba038.front.sepia.ceph.com:8000/ 2021-02-13T17:06:02.117 DEBUG:teuthology.orchestra.run.gibba038:> curl http://gibba038.front.sepia.ceph.com:8000/ 2021-02-13T17:06:02.145 INFO:teuthology.orchestra.run.gibba038.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:06:02.145 INFO:teuthology.orchestra.run.gibba038.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:06:02.151 INFO:teuthology.orchestra.run.gibba038.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 19454 0 --:--:-- --:--:-- --:--:-- 42800 2021-02-13T17:06:02.152 INFO:teuthology.orchestra.run.gibba038.stdout:anonymous 2021-02-13T17:06:02.152 INFO:tasks.rgw:Polling c2.client.1 until it starts accepting connections on http://gibba038.front.sepia.ceph.com:8001/ 2021-02-13T17:06:02.152 DEBUG:teuthology.orchestra.run.gibba038:> curl http://gibba038.front.sepia.ceph.com:8001/ 2021-02-13T17:06:02.202 INFO:teuthology.orchestra.run.gibba038.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:06:02.203 INFO:teuthology.orchestra.run.gibba038.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:06:02.208 INFO:teuthology.orchestra.run.gibba038.stdout:anonymous 2021-02-13T17:06:02.208 INFO:teuthology.orchestra.run.gibba038.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 42800 2021-02-13T17:06:02.208 INFO:teuthology.run_tasks:Running task rgw-multisite... 2021-02-13T17:06:02.375 INFO:tasks.rgw_multisite:creating realm.. 2021-02-13T17:06:02.375 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:02.375 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:02.375 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 realm create --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:06:02.431 INFO:teuthology.orchestra.run.gibba037.stdout:{"id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f","name":"test-realm","current_period":"967e305c-93b9-4525-a0c2-66b6df1c7c65","epoch":1} 2021-02-13T17:06:02.431 INFO:tasks.rgw_multisite:creating master zonegroup.. 2021-02-13T17:06:02.432 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:02.432 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:02.432 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup set --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:06:02.479 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:06:02.473 7f2c1c302940 -1 old format 2021-02-13T17:06:02.488 INFO:teuthology.orchestra.run.gibba037.stdout:{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"","zones":[],"placement_targets":[],"default_placement":"","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"} 2021-02-13T17:06:02.489 INFO:tasks.rgw_multisite:creating master zone.. 2021-02-13T17:06:02.489 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', 'MPD5WFU8HKLMFZF5', '--secret', 'OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH', '--endpoints', 'http://gibba037.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:02.489 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', 'MPD5WFU8HKLMFZF5', '--secret', 'OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH', '--endpoints', 'http://gibba037.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:02.489 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --master --access-key MPD5WFU8HKLMFZF5 --secret OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH --endpoints http://gibba037.front.sepia.ceph.com:8000 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:06:02.597 INFO:teuthology.orchestra.run.gibba037.stdout:{"id":"828f8250-b337-4094-a551-9a6ba396e2f7","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","system_key":{"access_key":"MPD5WFU8HKLMFZF5","secret_key":"OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"} 2021-02-13T17:06:02.598 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph osd pool create test-zone1.rgw.buckets.data 64 64 --cluster c1 2021-02-13T17:06:03.672 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'test-zone1.rgw.buckets.data' created 2021-02-13T17:06:03.685 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph osd pool application enable test-zone1.rgw.buckets.data rgw --cluster c1 2021-02-13T17:06:04.704 INFO:teuthology.orchestra.run.gibba037.stderr:enabled application 'rgw' on pool 'test-zone1.rgw.buckets.data' 2021-02-13T17:06:04.713 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:04.713 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:04.713 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:06:04.753 INFO:teuthology.orchestra.run.gibba037.stdout:{"id":"828f8250-b337-4094-a551-9a6ba396e2f7","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","system_key":{"access_key":"MPD5WFU8HKLMFZF5","secret_key":"OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":""} 2021-02-13T17:06:04.753 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:04.754 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:04.754 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:06:10.774 INFO:teuthology.orchestra.run.gibba037.stdout:{"id":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","epoch":1,"predecessor_uuid":"967e305c-93b9-4525-a0c2-66b6df1c7c65","sync_status":[],"period_map":{"id":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","zones":[{"id":"828f8250-b337-4094-a551-9a6ba396e2f7","name":"test-zone1","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"false","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"}],"short_zone_ids":[{"key":"828f8250-b337-4094-a551-9a6ba396e2f7","val":2513897494}]},"master_zonegroup":"test-zonegroup","master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f","realm_name":"test-realm","realm_epoch":2} 2021-02-13T17:06:10.775 DEBUG:tasks.rgw.c1.client.0:waiting for process to exit 2021-02-13T17:06:10.775 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T17:06:10.775 INFO:tasks.rgw.c1.client.0.gibba037.stdout:2021-02-13 17:06:10.769 7f81b3971700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground (PID: 15709) UID: 0 2021-02-13T17:06:10.776 INFO:tasks.rgw.c1.client.0.gibba037.stdout:2021-02-13 17:06:10.769 7f81ca2b8980 -1 shutting down 2021-02-13T17:06:10.821 INFO:tasks.rgw.c1.client.0:Stopped 2021-02-13T17:06:10.821 INFO:tasks.rgw.c1.client.0:Restarting daemon 2021-02-13T17:06:10.822 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2021-02-13T17:06:10.868 INFO:tasks.rgw.c1.client.0:Started 2021-02-13T17:06:10.869 DEBUG:teuthology.orchestra.run.gibba037:> curl http://gibba037.front.sepia.ceph.com:8000 2021-02-13T17:06:10.893 INFO:teuthology.orchestra.run.gibba037.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:06:10.893 INFO:teuthology.orchestra.run.gibba037.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:06:10.897 INFO:teuthology.orchestra.run.gibba037.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to gibba037.front.sepia.ceph.com port 8000: Connection refused 2021-02-13T17:06:10.899 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-02-13T17:06:11.900 DEBUG:teuthology.orchestra.run.gibba037:> curl http://gibba037.front.sepia.ceph.com:8000 2021-02-13T17:06:11.924 INFO:teuthology.orchestra.run.gibba037.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:06:11.924 INFO:teuthology.orchestra.run.gibba037.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:06:11.932 INFO:teuthology.orchestra.run.gibba037.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 26750 0 --:--:-- --:--:-- --:--:-- 26750 2021-02-13T17:06:11.933 INFO:teuthology.orchestra.run.gibba037.stdout:anonymous 2021-02-13T17:06:11.934 INFO:tasks.rgw_multisite:creating admin user.. 2021-02-13T17:06:11.934 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', 'MPD5WFU8HKLMFZF5', '--secret', 'OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:11.934 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', 'MPD5WFU8HKLMFZF5', '--secret', 'OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:11.934 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid realm-admin --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Realm Admin' --system --access-key MPD5WFU8HKLMFZF5 --secret OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:06:12.084 INFO:teuthology.orchestra.run.gibba037.stdout:{"user_id":"realm-admin","display_name":"Realm Admin","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"realm-admin","access_key":"MPD5WFU8HKLMFZF5","secret_key":"OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","system":"true","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2021-02-13T17:06:12.096 INFO:tasks.rgw_multisite:pulling realm configuration to c2 2021-02-13T17:06:12.096 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://gibba037.front.sepia.ceph.com:8000', '--access-key', 'MPD5WFU8HKLMFZF5', '--secret', 'OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:12.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://gibba037.front.sepia.ceph.com:8000', '--access-key', 'MPD5WFU8HKLMFZF5', '--secret', 'OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:12.097 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 realm pull --rgw-realm test-realm --url http://gibba037.front.sepia.ceph.com:8000 --access-key MPD5WFU8HKLMFZF5 --secret OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:06:12.200 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f","name":"test-realm","current_period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","epoch":2} 2021-02-13T17:06:12.201 INFO:tasks.rgw_multisite:creating zone.. 2021-02-13T17:06:12.201 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', 'MPD5WFU8HKLMFZF5', '--secret', 'OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH', '--endpoints', 'http://gibba038.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:12.201 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', 'MPD5WFU8HKLMFZF5', '--secret', 'OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH', '--endpoints', 'http://gibba038.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:12.201 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --access-key MPD5WFU8HKLMFZF5 --secret OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH --endpoints http://gibba038.front.sepia.ceph.com:8000 --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:06:12.252 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:12.246 7fe0c4975940 0 failed reading obj info from .rgw.root:zone_info.828f8250-b337-4094-a551-9a6ba396e2f7: (2) No such file or directory 2021-02-13T17:06:12.252 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:12.246 7fe0c4975940 0 WARNING: could not read zone params for zone id=828f8250-b337-4094-a551-9a6ba396e2f7 name=test-zone1 2021-02-13T17:06:12.257 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"MPD5WFU8HKLMFZF5","secret_key":"OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"} 2021-02-13T17:06:12.257 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph osd pool create test-zone2.rgw.buckets.data 64 64 --cluster c2 2021-02-13T17:06:12.578 INFO:teuthology.orchestra.run.gibba038.stderr:pool 'test-zone2.rgw.buckets.data' created 2021-02-13T17:06:12.587 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph osd pool application enable test-zone2.rgw.buckets.data rgw --cluster c2 2021-02-13T17:06:13.605 INFO:teuthology.orchestra.run.gibba038.stderr:enabled application 'rgw' on pool 'test-zone2.rgw.buckets.data' 2021-02-13T17:06:13.613 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:13.613 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:13.614 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:06:13.691 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"MPD5WFU8HKLMFZF5","secret_key":"OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":""} 2021-02-13T17:06:13.691 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:13.691 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:13.692 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:06:19.644 INFO:teuthology.orchestra.run.gibba038.stdout:Sending period to new master zone 828f8250-b337-4094-a551-9a6ba396e2f7 2021-02-13T17:06:20.750 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","epoch":2,"predecessor_uuid":"967e305c-93b9-4525-a0c2-66b6df1c7c65","sync_status":[],"period_map":{"id":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","zones":[{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","endpoints":["http://gibba038.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"828f8250-b337-4094-a551-9a6ba396e2f7","name":"test-zone1","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"}],"short_zone_ids":[{"key":"683fc559-f564-4678-9d94-a4eeda89e756","val":4148686205},{"key":"828f8250-b337-4094-a551-9a6ba396e2f7","val":2513897494}]},"master_zonegroup":"test-zonegroup","master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f","realm_name":"test-realm","realm_epoch":2} 2021-02-13T17:06:20.750 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2021-02-13T17:06:20.751 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T17:06:20.751 INFO:tasks.rgw.c2.client.0.gibba038.stdout:2021-02-13 17:06:20.746 7f9ad3d89700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground (PID: 15661) UID: 0 2021-02-13T17:06:20.751 INFO:tasks.rgw.c2.client.0.gibba038.stdout:2021-02-13 17:06:20.746 7f9aea6d0980 -1 shutting down 2021-02-13T17:06:26.852 INFO:tasks.rgw.c2.client.0:Stopped 2021-02-13T17:06:26.852 INFO:tasks.rgw.c2.client.0:Restarting daemon 2021-02-13T17:06:26.852 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2021-02-13T17:06:26.856 INFO:tasks.rgw.c2.client.0:Started 2021-02-13T17:06:26.856 DEBUG:teuthology.orchestra.run.gibba038:> curl http://gibba038.front.sepia.ceph.com:8000 2021-02-13T17:06:26.867 INFO:teuthology.orchestra.run.gibba038.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:06:26.868 INFO:teuthology.orchestra.run.gibba038.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:06:26.871 INFO:teuthology.orchestra.run.gibba038.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to gibba038.front.sepia.ceph.com port 8000: Connection refused 2021-02-13T17:06:26.872 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-02-13T17:06:27.873 DEBUG:teuthology.orchestra.run.gibba038:> curl http://gibba038.front.sepia.ceph.com:8000 2021-02-13T17:06:27.885 INFO:teuthology.orchestra.run.gibba038.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:06:27.886 INFO:teuthology.orchestra.run.gibba038.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:06:27.890 INFO:teuthology.orchestra.run.gibba038.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 42800 2021-02-13T17:06:27.891 INFO:teuthology.orchestra.run.gibba038.stdout:anonymous 2021-02-13T17:06:27.891 INFO:tasks.rgw_multisite:creating zone.. 2021-02-13T17:06:27.892 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'MPD5WFU8HKLMFZF5', '--secret', 'OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH', '--endpoints', 'http://gibba037.front.sepia.ceph.com:8001', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:27.892 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'MPD5WFU8HKLMFZF5', '--secret', 'OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH', '--endpoints', 'http://gibba037.front.sepia.ceph.com:8001', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:27.892 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --access-key MPD5WFU8HKLMFZF5 --secret OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH --endpoints http://gibba037.front.sepia.ceph.com:8001 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:06:27.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:06:27.945 7f491b14d940 0 failed reading obj info from .rgw.root:zone_info.683fc559-f564-4678-9d94-a4eeda89e756: (2) No such file or directory 2021-02-13T17:06:27.954 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:06:27.945 7f491b14d940 0 WARNING: could not read zone params for zone id=683fc559-f564-4678-9d94-a4eeda89e756 name=test-zone2 2021-02-13T17:06:27.958 INFO:teuthology.orchestra.run.gibba037.stdout:{"id":"0309fa59-88d6-4791-9422-c40c249763c5","name":"test-zone3","domain_root":"test-zone3.rgw.meta:root","control_pool":"test-zone3.rgw.control","gc_pool":"test-zone3.rgw.log:gc","lc_pool":"test-zone3.rgw.log:lc","log_pool":"test-zone3.rgw.log","intent_log_pool":"test-zone3.rgw.log:intent","usage_log_pool":"test-zone3.rgw.log:usage","reshard_pool":"test-zone3.rgw.log:reshard","user_keys_pool":"test-zone3.rgw.meta:users.keys","user_email_pool":"test-zone3.rgw.meta:users.email","user_swift_pool":"test-zone3.rgw.meta:users.swift","user_uid_pool":"test-zone3.rgw.meta:users.uid","otp_pool":"test-zone3.rgw.otp","system_key":{"access_key":"MPD5WFU8HKLMFZF5","secret_key":"OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone3.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone3.rgw.buckets.data"}},"data_extra_pool":"test-zone3.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"} 2021-02-13T17:06:27.959 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph osd pool create test-zone3.rgw.buckets.data 64 64 --cluster c1 2021-02-13T17:06:28.178 INFO:teuthology.orchestra.run.gibba037.stderr:pool 'test-zone3.rgw.buckets.data' created 2021-02-13T17:06:28.186 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph osd pool application enable test-zone3.rgw.buckets.data rgw --cluster c1 2021-02-13T17:06:29.208 INFO:teuthology.orchestra.run.gibba037.stderr:enabled application 'rgw' on pool 'test-zone3.rgw.buckets.data' 2021-02-13T17:06:29.218 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:29.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:29.219 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:06:29.256 INFO:teuthology.orchestra.run.gibba037.stdout:{"id":"0309fa59-88d6-4791-9422-c40c249763c5","name":"test-zone3","domain_root":"test-zone3.rgw.meta:root","control_pool":"test-zone3.rgw.control","gc_pool":"test-zone3.rgw.log:gc","lc_pool":"test-zone3.rgw.log:lc","log_pool":"test-zone3.rgw.log","intent_log_pool":"test-zone3.rgw.log:intent","usage_log_pool":"test-zone3.rgw.log:usage","reshard_pool":"test-zone3.rgw.log:reshard","user_keys_pool":"test-zone3.rgw.meta:users.keys","user_email_pool":"test-zone3.rgw.meta:users.email","user_swift_pool":"test-zone3.rgw.meta:users.swift","user_uid_pool":"test-zone3.rgw.meta:users.uid","otp_pool":"test-zone3.rgw.otp","system_key":{"access_key":"MPD5WFU8HKLMFZF5","secret_key":"OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone3.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone3.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone3.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":""} 2021-02-13T17:06:29.256 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:29.256 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:29.257 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:06:35.244 INFO:teuthology.orchestra.run.gibba037.stdout:Sending period to new master zone 828f8250-b337-4094-a551-9a6ba396e2f7 2021-02-13T17:06:36.295 INFO:teuthology.orchestra.run.gibba037.stdout:{"id":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","epoch":3,"predecessor_uuid":"967e305c-93b9-4525-a0c2-66b6df1c7c65","sync_status":[],"period_map":{"id":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","zones":[{"id":"0309fa59-88d6-4791-9422-c40c249763c5","name":"test-zone3","endpoints":["http://gibba037.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","endpoints":["http://gibba038.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"828f8250-b337-4094-a551-9a6ba396e2f7","name":"test-zone1","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"}],"short_zone_ids":[{"key":"0309fa59-88d6-4791-9422-c40c249763c5","val":2792335811},{"key":"683fc559-f564-4678-9d94-a4eeda89e756","val":4148686205},{"key":"828f8250-b337-4094-a551-9a6ba396e2f7","val":2513897494}]},"master_zonegroup":"test-zonegroup","master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f","realm_name":"test-realm","realm_epoch":2} 2021-02-13T17:06:36.295 DEBUG:tasks.rgw.c1.client.1:waiting for process to exit 2021-02-13T17:06:36.295 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T17:06:36.296 INFO:tasks.rgw.c1.client.1.gibba037.stdout:2021-02-13 17:06:36.288 7f2e613a8700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground (PID: 15711) UID: 0 2021-02-13T17:06:36.296 INFO:tasks.rgw.c1.client.1.gibba037.stdout:2021-02-13 17:06:36.288 7f2e77cef980 -1 shutting down 2021-02-13T17:06:36.371 INFO:tasks.rgw.c1.client.1:Stopped 2021-02-13T17:06:36.371 INFO:tasks.rgw.c1.client.1:Restarting daemon 2021-02-13T17:06:36.371 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c1.client.1.stdout 2>&1 2021-02-13T17:06:36.413 INFO:tasks.rgw.c1.client.1:Started 2021-02-13T17:06:36.414 DEBUG:teuthology.orchestra.run.gibba037:> curl http://gibba037.front.sepia.ceph.com:8001 2021-02-13T17:06:36.421 INFO:teuthology.orchestra.run.gibba037.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:06:36.421 INFO:teuthology.orchestra.run.gibba037.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:06:36.424 INFO:teuthology.orchestra.run.gibba037.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to gibba037.front.sepia.ceph.com port 8001: Connection refused 2021-02-13T17:06:36.425 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-02-13T17:06:37.426 DEBUG:teuthology.orchestra.run.gibba037:> curl http://gibba037.front.sepia.ceph.com:8001 2021-02-13T17:06:37.437 INFO:teuthology.orchestra.run.gibba037.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:06:37.438 INFO:teuthology.orchestra.run.gibba037.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:06:37.443 INFO:teuthology.orchestra.run.gibba037.stdout:anonymous 2021-02-13T17:06:37.443 INFO:teuthology.orchestra.run.gibba037.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 42800 2021-02-13T17:06:37.444 INFO:tasks.rgw_multisite:pulling realm configuration to c2 2021-02-13T17:06:37.444 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://gibba037.front.sepia.ceph.com:8000', '--access-key', 'MPD5WFU8HKLMFZF5', '--secret', 'OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH', '--url', 'http://gibba037.front.sepia.ceph.com:8000', '--access-key', 'MPD5WFU8HKLMFZF5', '--secret', 'OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:37.444 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://gibba037.front.sepia.ceph.com:8000', '--access-key', 'MPD5WFU8HKLMFZF5', '--secret', 'OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH', '--url', 'http://gibba037.front.sepia.ceph.com:8000', '--access-key', 'MPD5WFU8HKLMFZF5', '--secret', 'OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:37.444 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 realm pull --rgw-realm test-realm --url http://gibba037.front.sepia.ceph.com:8000 --access-key MPD5WFU8HKLMFZF5 --secret OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH --url http://gibba037.front.sepia.ceph.com:8000 --access-key MPD5WFU8HKLMFZF5 --secret OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:06:37.541 INFO:tasks.rgw.c2.client.0.gibba038.stdout:2021-02-13 17:06:37.534 7ff1784e4700 -1 rgw realm watcher: RGWRealmWatcher::handle_error oid=realms.ba7ca85e-f700-4f2a-9213-44136dc07f4f.control err=-107 2021-02-13T17:06:37.550 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f","name":"test-realm","current_period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","epoch":2} 2021-02-13T17:06:37.550 INFO:tasks.rgw_multisite:creating zone.. 2021-02-13T17:06:37.550 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'MPD5WFU8HKLMFZF5', '--secret', 'OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH', '--endpoints', 'http://gibba038.front.sepia.ceph.com:8001', '--tier-type', 'pubsub', '--sync-from-all=0', '--sync-from', 'test-zone1', '--tier-config', 'start_with_full_sync=false,event_retention_days=7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:37.550 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'MPD5WFU8HKLMFZF5', '--secret', 'OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH', '--endpoints', 'http://gibba038.front.sepia.ceph.com:8001', '--tier-type', 'pubsub', '--sync-from-all=0', '--sync-from', 'test-zone1', '--tier-config', 'start_with_full_sync=false,event_retention_days=7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:37.551 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --access-key MPD5WFU8HKLMFZF5 --secret OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH --endpoints http://gibba038.front.sepia.ceph.com:8001 --tier-type pubsub --sync-from-all=0 --sync-from test-zone1 --tier-config start_with_full_sync=false,event_retention_days=7 --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:06:37.604 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:37.598 7ff6a529b940 0 failed reading obj info from .rgw.root:zone_info.0309fa59-88d6-4791-9422-c40c249763c5: (2) No such file or directory 2021-02-13T17:06:37.604 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:37.598 7ff6a529b940 0 WARNING: could not read zone params for zone id=0309fa59-88d6-4791-9422-c40c249763c5 name=test-zone3 2021-02-13T17:06:37.605 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:37.598 7ff6a529b940 0 failed reading obj info from .rgw.root:zone_info.828f8250-b337-4094-a551-9a6ba396e2f7: (2) No such file or directory 2021-02-13T17:06:37.605 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:06:37.598 7ff6a529b940 0 WARNING: could not read zone params for zone id=828f8250-b337-4094-a551-9a6ba396e2f7 name=test-zone1 2021-02-13T17:06:37.608 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"64418f57-773e-4390-b4e5-412c8c3de8c5","name":"test-zone4","domain_root":"test-zone4.rgw.meta:root","control_pool":"test-zone4.rgw.control","gc_pool":"test-zone4.rgw.log:gc","lc_pool":"test-zone4.rgw.log:lc","log_pool":"test-zone4.rgw.log","intent_log_pool":"test-zone4.rgw.log:intent","usage_log_pool":"test-zone4.rgw.log:usage","reshard_pool":"test-zone4.rgw.log:reshard","user_keys_pool":"test-zone4.rgw.meta:users.keys","user_email_pool":"test-zone4.rgw.meta:users.email","user_swift_pool":"test-zone4.rgw.meta:users.swift","user_uid_pool":"test-zone4.rgw.meta:users.uid","otp_pool":"test-zone4.rgw.otp","system_key":{"access_key":"MPD5WFU8HKLMFZF5","secret_key":"OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone4.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone4.rgw.buckets.data"}},"data_extra_pool":"test-zone4.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","tier_config":{"event_retention_days":7,"start_with_full_sync":false},"realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"} 2021-02-13T17:06:37.609 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph osd pool create test-zone4.rgw.buckets.data 64 64 --cluster c2 2021-02-13T17:06:38.593 INFO:teuthology.orchestra.run.gibba038.stderr:pool 'test-zone4.rgw.buckets.data' created 2021-02-13T17:06:38.599 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph osd pool application enable test-zone4.rgw.buckets.data rgw --cluster c2 2021-02-13T17:06:39.621 INFO:teuthology.orchestra.run.gibba038.stderr:enabled application 'rgw' on pool 'test-zone4.rgw.buckets.data' 2021-02-13T17:06:39.629 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:39.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:39.630 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:06:39.666 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"64418f57-773e-4390-b4e5-412c8c3de8c5","name":"test-zone4","domain_root":"test-zone4.rgw.meta:root","control_pool":"test-zone4.rgw.control","gc_pool":"test-zone4.rgw.log:gc","lc_pool":"test-zone4.rgw.log:lc","log_pool":"test-zone4.rgw.log","intent_log_pool":"test-zone4.rgw.log:intent","usage_log_pool":"test-zone4.rgw.log:usage","reshard_pool":"test-zone4.rgw.log:reshard","user_keys_pool":"test-zone4.rgw.meta:users.keys","user_email_pool":"test-zone4.rgw.meta:users.email","user_swift_pool":"test-zone4.rgw.meta:users.swift","user_uid_pool":"test-zone4.rgw.meta:users.uid","otp_pool":"test-zone4.rgw.otp","system_key":{"access_key":"MPD5WFU8HKLMFZF5","secret_key":"OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone4.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone4.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone4.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","tier_config":{"event_retention_days":7,"start_with_full_sync":false},"realm_id":""} 2021-02-13T17:06:39.667 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:39.667 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:39.667 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:06:45.655 INFO:teuthology.orchestra.run.gibba038.stdout:Sending period to new master zone 828f8250-b337-4094-a551-9a6ba396e2f7 2021-02-13T17:06:46.839 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","epoch":4,"predecessor_uuid":"967e305c-93b9-4525-a0c2-66b6df1c7c65","sync_status":[],"period_map":{"id":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","zones":[{"id":"0309fa59-88d6-4791-9422-c40c249763c5","name":"test-zone3","endpoints":["http://gibba037.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"64418f57-773e-4390-b4e5-412c8c3de8c5","name":"test-zone4","endpoints":["http://gibba038.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","endpoints":["http://gibba038.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"828f8250-b337-4094-a551-9a6ba396e2f7","name":"test-zone1","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"}],"short_zone_ids":[{"key":"0309fa59-88d6-4791-9422-c40c249763c5","val":2792335811},{"key":"64418f57-773e-4390-b4e5-412c8c3de8c5","val":3971286608},{"key":"683fc559-f564-4678-9d94-a4eeda89e756","val":4148686205},{"key":"828f8250-b337-4094-a551-9a6ba396e2f7","val":2513897494}]},"master_zonegroup":"test-zonegroup","master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f","realm_name":"test-realm","realm_epoch":2} 2021-02-13T17:06:46.840 DEBUG:tasks.rgw.c2.client.1:waiting for process to exit 2021-02-13T17:06:46.840 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T17:06:46.841 INFO:tasks.rgw.c2.client.1.gibba038.stdout:2021-02-13 17:06:46.836 7f8da164c700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground (PID: 15664) UID: 0 2021-02-13T17:06:46.841 INFO:tasks.rgw.c2.client.1.gibba038.stdout:2021-02-13 17:06:46.836 7f8db7f93980 -1 shutting down 2021-02-13T17:06:52.942 INFO:tasks.rgw.c2.client.1:Stopped 2021-02-13T17:06:52.942 INFO:tasks.rgw.c2.client.1:Restarting daemon 2021-02-13T17:06:52.943 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2021-02-13T17:06:52.945 INFO:tasks.rgw.c2.client.1:Started 2021-02-13T17:06:52.945 DEBUG:teuthology.orchestra.run.gibba038:> curl http://gibba038.front.sepia.ceph.com:8001 2021-02-13T17:06:52.957 INFO:teuthology.orchestra.run.gibba038.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:06:52.957 INFO:teuthology.orchestra.run.gibba038.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:06:52.960 INFO:teuthology.orchestra.run.gibba038.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to gibba038.front.sepia.ceph.com port 8001: Connection refused 2021-02-13T17:06:52.961 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-02-13T17:06:53.962 DEBUG:teuthology.orchestra.run.gibba038:> curl http://gibba038.front.sepia.ceph.com:8001 2021-02-13T17:06:53.973 INFO:teuthology.orchestra.run.gibba038.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:06:53.973 INFO:teuthology.orchestra.run.gibba038.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:06:53.977 INFO:teuthology.orchestra.run.gibba038.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 134 100 134 0 0 33500 0 --:--:-- --:--:-- --:--:-- 33500 2021-02-13T17:06:53.978 INFO:teuthology.orchestra.run.gibba038.stdout:{"Code":"MethodNotAllowed","RequestId":"tx000000000000000000001-006028072d-10e0-test-zone4","HostId":"10e0-test-zone4-test-zonegroup"} 2021-02-13T17:06:53.978 INFO:tasks.rgw_multisite:rgw multisite configuration completed 2021-02-13T17:06:53.979 INFO:teuthology.run_tasks:Running task rgw-multisite-tests... 2021-02-13T17:06:54.028 INFO:tasks.rgw_multisite_tests:creating test user.. 2021-02-13T17:06:54.028 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'rgw-multisite-test-user', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Multisite Test User', '--gen-access-key', '--gen-secret', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:54.028 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'rgw-multisite-test-user', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Multisite Test User', '--gen-access-key', '--gen-secret', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:06:54.028 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid rgw-multisite-test-user --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Multisite Test User' --gen-access-key --gen-secret --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:06:54.109 INFO:teuthology.orchestra.run.gibba037.stdout:{"user_id":"rgw-multisite-test-user","display_name":"Multisite Test User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"rgw-multisite-test-user","access_key":"07UIPK5U02NYPEGMLY56","secret_key":"Yu9W6Ni6JkSKnLOSVaUlpXQm9HvP0hfDXn3YLR2P"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2021-02-13T17:06:54.123 INFO:rgw_multi.tests:meta checkpoint 2021-02-13T17:06:54.123 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:06:54.123 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:06:54.123 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:06:54.205 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=efc2d01e-ebf2-4522-b313-ef15a0018fb0 2021-02-13T17:06:54.238 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"1_1613236014.104172_63.1","last_update":"2021-02-13 17:06:54.104172Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-02-13T17:06:54.238 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:06:54.238 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:06:54.238 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:06:54.239 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:06:54.359 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:06:54.360 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:06:59.360 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:06:59.361 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:06:59.361 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:06:59.443 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:06:59.444 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:07:04.444 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:04.445 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:04.445 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:07:04.531 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:07:04.531 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:07:09.532 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:09.532 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:09.532 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:07:09.608 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:07:09.608 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:07:14.609 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:14.610 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:14.610 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:07:14.695 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:07:14.695 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:07:19.696 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:19.696 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:19.696 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:07:19.786 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:07:19.786 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:07:24.787 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:24.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:24.788 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:07:24.871 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:07:24.872 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:07:29.873 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:29.873 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:29.873 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:07:29.951 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:07:29.951 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:07:34.952 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:34.952 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:34.952 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:07:35.043 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:07:35.043 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:07:40.044 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:40.044 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:40.044 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:07:40.123 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:07:40.124 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:07:45.124 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:45.124 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:45.125 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:07:45.205 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:07:45.206 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:07:50.207 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:50.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:50.207 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:07:50.291 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:07:50.292 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:07:55.293 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:55.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:07:55.294 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:07:55.382 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:07:55.382 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:08:00.383 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:00.383 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:00.383 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:00.464 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:08:00.464 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:08:05.465 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:05.465 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:05.466 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:05.545 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:08:05.545 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:08:10.546 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:10.546 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:10.547 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:10.634 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:08:10.635 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:08:15.635 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:15.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:15.636 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:15.721 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:08:15.722 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:08:20.722 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:20.722 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:20.723 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:20.811 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:08:20.812 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:08:25.813 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:25.813 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:25.813 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:25.903 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:08:25.903 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:08:30.905 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:30.905 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:30.905 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:30.993 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:08:30.994 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:08:35.995 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:35.995 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:35.996 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:36.081 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:08:36.081 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:08:41.082 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:41.082 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:41.083 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:41.159 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:08:41.160 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:08:46.161 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:46.161 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:46.161 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:46.243 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:08:46.243 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613236014.104172_63.1 target= 2021-02-13T17:08:51.245 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:51.245 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:51.245 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:51.321 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:08:51.322 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:08:51.322 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:08:51.322 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:51.322 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:51.322 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:51.407 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:08:51.408 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:08:51.408 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:08:51.408 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:51.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:51.408 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:51.586 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:08:51.587 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:08:51.587 INFO:rgw_multi.tests:meta checkpoint 2021-02-13T17:08:51.587 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:51.587 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:51.587 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:51.693 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=efc2d01e-ebf2-4522-b313-ef15a0018fb0 2021-02-13T17:08:51.708 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"1_1613236014.104172_63.1","last_update":"2021-02-13 17:06:54.104172Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-02-13T17:08:51.709 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:08:51.709 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:51.709 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:51.709 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:51.801 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:08:51.801 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:08:51.801 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:08:51.801 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:51.801 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:51.802 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:51.920 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:08:51.920 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:08:51.920 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:08:51.920 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:51.921 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:51.921 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:52.099 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:08:52.099 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:08:52.099 INFO:tasks.rgw_multisite_tests:running rgw multisite tests on 'tasks.rgw_multi.tests' with args=[] 2021-02-13T17:08:52.106 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-1 2021-02-13T17:08:53.212 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-2 2021-02-13T17:08:54.390 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=fggivf-3 2021-02-13T17:08:56.220 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:56.220 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:56.220 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:56.279 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=efc2d01e-ebf2-4522-b313-ef15a0018fb0 2021-02-13T17:08:56.295 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"1_1613236014.104172_63.1","last_update":"2021-02-13 17:06:54.104172Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613236134.444689_71.1","last_update":"2021-02-13 17:08:54.444689Z"}] 2021-02-13T17:08:56.295 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:08:56.296 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:56.296 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:56.296 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:56.395 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236134.444689_71.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:08:54.444689Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:08:56.396 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:08:56.396 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:08:56.396 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:56.396 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:56.396 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:56.516 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236134.444689_71.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:08:54.444689Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:08:56.516 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:08:56.516 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:08:56.517 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:56.517 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:56.517 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:56.728 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236134.444689_71.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:08:54.444689Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:08:56.729 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:08:56.760 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_create ... ok 2021-02-13T17:08:56.761 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-4 2021-02-13T17:08:56.822 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-5 2021-02-13T17:08:56.922 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=fggivf-6 2021-02-13T17:08:57.020 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:57.020 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:57.020 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:57.119 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=efc2d01e-ebf2-4522-b313-ef15a0018fb0 2021-02-13T17:08:57.134 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"1_1613236014.104172_63.1","last_update":"2021-02-13 17:06:54.104172Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613236136.973626_83.1","last_update":"2021-02-13 17:08:56.973626Z"}] 2021-02-13T17:08:57.134 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:08:57.134 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:57.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:08:57.135 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:08:57.211 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236134.444689_71.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:08:54.444689Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:08:57.212 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613236136.973626_83.1 target=1_1613236134.444689_71.1 2021-02-13T17:09:02.212 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:02.213 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:02.213 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:02.291 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236136.973626_83.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:08:56.973626Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:02.291 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:09:02.291 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:09:02.291 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:02.292 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:02.292 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:02.379 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236136.973626_83.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:08:56.973626Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:02.380 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:09:02.380 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:09:02.380 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:02.380 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:02.380 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:02.593 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236136.973626_83.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:08:56.973626Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:02.593 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:09:03.723 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:03.723 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:03.723 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:03.816 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=efc2d01e-ebf2-4522-b313-ef15a0018fb0 2021-02-13T17:09:03.830 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"1_1613236014.104172_63.1","last_update":"2021-02-13 17:06:54.104172Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613236143.577282_137.1","last_update":"2021-02-13 17:09:03.577282Z"}] 2021-02-13T17:09:03.830 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:09:03.831 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:03.831 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:03.831 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:03.915 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236142.750685_93.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:02.750685Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:03.915 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613236143.577282_137.1 target=1_1613236142.750685_93.1 2021-02-13T17:09:08.916 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:08.916 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:08.916 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:08.993 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236142.872078_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:02.872078Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:08.993 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613236143.577282_137.1 target=1_1613236142.872078_103.1 2021-02-13T17:09:13.994 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:13.994 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:13.995 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:14.119 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236143.015207_113.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:03.015207Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:14.119 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613236143.577282_137.1 target=1_1613236143.015207_113.1 2021-02-13T17:09:19.121 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:19.121 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:19.121 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:19.207 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236143.577282_137.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:03.577282Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:19.208 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:09:19.208 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:09:19.208 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:19.208 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:19.209 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:19.291 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236143.577282_137.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:03.577282Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:19.292 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:09:19.292 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:09:19.292 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:19.292 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:19.292 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:19.470 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236143.577282_137.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:03.577282Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:19.470 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:09:19.512 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_recreate ... ok 2021-02-13T17:09:19.512 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-7 2021-02-13T17:09:19.578 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-8 2021-02-13T17:09:19.678 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=fggivf-9 2021-02-13T17:09:19.777 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:19.777 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:19.778 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:19.876 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=efc2d01e-ebf2-4522-b313-ef15a0018fb0 2021-02-13T17:09:19.891 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"1_1613236014.104172_63.1","last_update":"2021-02-13 17:06:54.104172Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613236159.729777_149.1","last_update":"2021-02-13 17:09:19.729777Z"}] 2021-02-13T17:09:19.891 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:09:19.891 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:19.891 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:19.892 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:19.978 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236143.577282_137.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:03.577282Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:19.978 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613236159.729777_149.1 target=1_1613236143.577282_137.1 2021-02-13T17:09:24.979 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:24.979 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:24.979 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:25.067 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236159.729777_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:19.729777Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:25.068 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:09:25.068 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:09:25.068 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:25.068 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:25.069 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:25.151 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236159.729777_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:19.729777Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:25.151 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:09:25.151 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:09:25.152 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:25.152 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:25.152 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:25.368 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236159.729777_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:19.729777Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:25.368 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:09:25.618 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:25.618 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:25.618 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:25.720 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=efc2d01e-ebf2-4522-b313-ef15a0018fb0 2021-02-13T17:09:25.735 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"1_1613236014.104172_63.1","last_update":"2021-02-13 17:06:54.104172Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613236165.569853_155.1","last_update":"2021-02-13 17:09:25.569853Z"}] 2021-02-13T17:09:25.735 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:09:25.735 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:25.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:25.736 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:25.819 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236159.729777_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:19.729777Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:25.819 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613236165.569853_155.1 target=1_1613236159.729777_149.1 2021-02-13T17:09:30.820 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:30.821 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:30.821 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:30.903 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:30.903 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:09:30.904 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:09:30.904 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:30.904 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:30.904 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:30.987 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:30.987 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:09:30.987 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:09:30.987 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:30.987 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:30.987 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:31.165 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:31.165 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:09:31.188 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_remove ... ok 2021-02-13T17:09:31.188 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-10 2021-02-13T17:09:31.249 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-11 2021-02-13T17:09:31.350 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=fggivf-12 2021-02-13T17:09:32.027 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:32.027 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:32.027 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:32.128 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=efc2d01e-ebf2-4522-b313-ef15a0018fb0 2021-02-13T17:09:32.143 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"1_1613236014.104172_63.1","last_update":"2021-02-13 17:06:54.104172Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613236171.401277_64.1","last_update":"2021-02-13 17:09:31.401277Z"},{"marker":"1_1613236165.569853_155.1","last_update":"2021-02-13 17:09:25.569853Z"}] 2021-02-13T17:09:32.144 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:09:32.144 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:32.144 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:32.144 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:32.228 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:32.229 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613236171.401277_64.1 target= 2021-02-13T17:09:37.229 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:37.229 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:37.230 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:37.310 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613236171.401277_64.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:31.401277Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:37.310 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:09:37.310 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:09:37.311 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:37.311 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:37.311 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:37.396 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613236171.401277_64.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:31.401277Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:37.396 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:09:37.396 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:09:37.396 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:37.396 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:37.397 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:37.610 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613236171.401277_64.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:31.401277Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:09:37.611 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:09:37.611 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:37.611 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:37.611 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-10 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:37.699 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000008.9.5"}]} 2021-02-13T17:09:37.700 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-10 2021-02-13T17:09:37.700 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:37.700 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:37.700 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-10 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:37.828 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.9.5"}}}] 2021-02-13T17:09:37.829 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-10 2021-02-13T17:09:37.829 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-10 zones={test-zone2, test-zone1} 2021-02-13T17:09:37.835 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:09:37.838 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-02-13T17:09:37.838 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-02-13T17:09:37.838 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-02-13T17:09:37.838 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:09:37.838 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:09:37.844 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-02-13T17:09:37.844 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-02-13T17:09:37.844 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-02-13T17:09:37.844 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:09:37.850 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:09:37.906 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:09:38.015 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:09:38.123 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:09:38.182 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:09:38.299 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:09:38.403 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:09:38.462 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:09:38.574 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:09:38.679 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:09:38.740 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:09:38.851 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:09:38.955 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-10 zones={test-zone2, test-zone1} 2021-02-13T17:09:38.955 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:38.955 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:38.956 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-10 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:39.034 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000008.9.5"}]} 2021-02-13T17:09:39.034 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-10 2021-02-13T17:09:39.034 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:39.034 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:39.035 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-10 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:39.121 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.9.5"}}}] 2021-02-13T17:09:39.122 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-10 2021-02-13T17:09:39.122 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-10 zones={test-zone3, test-zone1} 2021-02-13T17:09:39.125 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:09:39.128 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-02-13T17:09:39.128 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-02-13T17:09:39.128 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-02-13T17:09:39.128 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:09:39.128 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:09:39.132 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-02-13T17:09:39.132 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-02-13T17:09:39.132 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-02-13T17:09:39.132 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:09:39.137 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:09:39.195 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:09:39.316 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:09:39.423 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:09:39.489 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:09:39.599 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:09:39.714 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:09:39.797 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:09:39.927 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:09:40.040 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:09:40.101 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:09:40.212 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:09:40.319 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-10 zones={test-zone3, test-zone1} 2021-02-13T17:09:40.319 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:40.320 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:40.320 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-10 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:40.442 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000008.9.5"}]} 2021-02-13T17:09:40.443 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-10 2021-02-13T17:09:40.443 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:40.443 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:40.443 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-10 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:40.618 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.9.5"}}}] 2021-02-13T17:09:40.619 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-10 2021-02-13T17:09:40.619 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:40.620 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:40.620 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:40.744 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000008.8.5"}]} 2021-02-13T17:09:40.744 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-11 2021-02-13T17:09:40.744 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:40.744 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:40.745 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:40.837 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.8.5"}}}] 2021-02-13T17:09:40.837 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-11 2021-02-13T17:09:40.837 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-11 zones={test-zone1, test-zone2} 2021-02-13T17:09:40.845 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:09:40.848 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-02-13T17:09:40.848 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-02-13T17:09:40.848 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-02-13T17:09:40.849 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:09:40.849 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:09:40.855 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-02-13T17:09:40.855 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-02-13T17:09:40.855 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-02-13T17:09:40.855 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:09:40.864 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:09:40.923 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:09:41.034 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:09:41.135 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:09:41.194 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:09:41.306 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:09:41.407 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:09:41.471 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:09:41.583 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:09:41.692 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:09:41.750 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:09:41.864 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:09:41.968 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-11 zones={test-zone1, test-zone2} 2021-02-13T17:09:41.968 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:41.968 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:41.968 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:42.090 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000008.8.5"}]} 2021-02-13T17:09:42.090 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-11 2021-02-13T17:09:42.090 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:42.091 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:42.091 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:42.175 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.8.5"}}}] 2021-02-13T17:09:42.176 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-11 2021-02-13T17:09:42.176 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-11 zones={test-zone3, test-zone2} 2021-02-13T17:09:42.181 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:09:42.183 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-02-13T17:09:42.184 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-02-13T17:09:42.184 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-02-13T17:09:42.184 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:09:42.184 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:09:42.188 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-02-13T17:09:42.189 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-02-13T17:09:42.189 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-02-13T17:09:42.189 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:09:42.196 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:09:42.252 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:09:42.369 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:09:42.479 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:09:42.539 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:09:42.651 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:09:42.751 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:09:42.811 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:09:42.932 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:09:43.040 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:09:43.098 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:09:43.213 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:09:43.319 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-11 zones={test-zone3, test-zone2} 2021-02-13T17:09:43.320 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:43.320 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:43.320 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:43.400 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000008.8.5"}]} 2021-02-13T17:09:43.400 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-11 2021-02-13T17:09:43.400 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:43.401 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:43.401 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:43.580 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:09:43.581 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:09:48.581 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:48.582 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:48.582 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:48.763 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:09:48.764 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:09:53.765 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:53.765 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:53.765 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:53.947 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:09:53.947 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:09:58.948 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:58.949 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:09:58.949 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:09:59.121 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:09:59.121 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:10:04.122 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:04.122 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:04.123 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:10:04.305 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:10:04.305 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:10:09.306 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:09.307 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:09.307 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:10:09.489 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:10:09.489 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:10:14.490 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:14.491 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:14.491 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:10:14.675 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:10:14.675 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:10:19.676 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:19.676 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:19.676 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:10:19.851 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:10:19.852 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:10:24.853 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:24.853 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:24.854 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:10:25.034 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:10:25.034 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:10:30.035 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:30.036 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:30.036 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:10:30.208 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:10:30.209 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:10:35.209 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:35.209 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:35.210 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:10:35.387 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:10:35.387 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:10:40.388 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:40.389 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:40.389 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:10:40.564 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:10:40.565 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:10:45.565 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:45.566 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:45.566 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:10:45.741 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:10:45.741 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:10:50.742 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:50.742 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:50.742 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:10:50.919 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:10:50.920 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:10:55.921 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:55.921 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:10:55.921 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:10:56.103 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:10:56.103 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:11:01.104 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:01.104 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:01.105 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:11:01.278 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:11:01.278 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:11:06.282 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:06.282 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:06.282 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:11:06.460 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:11:06.461 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:11:11.462 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:11.462 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:11.462 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:11:11.637 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:11:11.637 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:11:16.639 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:16.639 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:16.639 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:11:16.820 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:11:16.821 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:11:21.821 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:21.821 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:21.822 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:11:21.999 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:11:22.000 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:11:27.001 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:27.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:27.001 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:11:27.179 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:11:27.179 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:11:32.180 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:32.180 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:32.181 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:11:32.361 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:11:32.362 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:11:37.363 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:37.363 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:37.363 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:11:37.543 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:11:37.543 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:11:42.544 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:42.544 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:42.545 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:11:42.729 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:11:42.730 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:11:47.730 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:47.731 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:47.731 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:11:47.912 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:11:47.913 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:11:52.914 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:52.914 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:52.915 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:11:53.096 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:11:53.096 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:11:58.097 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:58.097 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:11:58.098 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:11:58.272 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:11:58.272 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:12:03.273 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:03.274 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:03.274 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:12:03.447 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:12:03.448 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:12:08.449 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:08.449 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:08.450 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:12:08.632 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:12:08.633 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:12:13.633 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:13.634 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:13.634 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:12:13.811 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:12:13.811 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:12:18.812 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:18.813 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:18.813 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:12:18.993 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:12:18.993 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:12:23.994 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:23.994 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:23.995 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:12:24.170 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:12:24.170 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:12:29.171 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:29.171 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:29.172 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:12:29.348 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:12:29.349 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:12:34.349 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:34.377 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:34.377 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:12:34.559 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:12:34.559 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:12:39.560 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:39.560 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:39.560 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:12:39.740 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:12:39.741 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:12:44.742 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:44.742 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:44.742 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:12:44.926 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:12:44.927 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:12:49.928 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:49.928 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:49.928 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:12:50.103 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:12:50.104 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:12:55.105 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:55.105 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:12:55.105 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:12:55.279 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:12:55.279 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:13:00.280 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:00.281 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:00.281 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:13:00.465 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:13:00.465 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:13:05.466 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:05.466 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:05.466 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:13:05.651 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:13:05.652 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:13:10.652 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:10.652 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:10.653 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:13:10.828 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:13:10.829 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:13:15.830 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:15.830 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:15.831 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:13:16.013 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:13:16.013 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:13:21.014 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:21.014 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:21.014 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:13:21.191 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:13:21.191 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:13:26.192 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:26.192 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:26.192 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:13:26.367 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:13:26.367 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:13:31.367 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:31.368 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:31.368 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:13:31.546 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:13:31.546 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:13:36.547 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:36.547 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:36.548 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:13:36.741 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:13:36.741 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:13:41.742 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:41.742 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:41.743 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:13:41.921 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:13:41.921 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:13:46.922 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:46.922 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:46.922 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:13:47.100 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:13:47.100 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:13:52.101 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:52.101 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:52.102 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:13:52.281 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:13:52.281 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:13:57.282 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:57.282 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:13:57.282 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:13:57.498 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:13:57.499 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:14:02.499 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:02.500 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:02.500 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:14:02.676 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:14:02.676 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:14:07.678 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:07.678 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:07.678 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:14:07.859 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:14:07.859 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:14:12.860 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:12.860 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:12.861 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:14:13.036 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:14:13.036 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:14:18.038 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:18.038 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:18.038 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:14:18.218 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:14:18.219 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:14:23.220 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:23.220 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:23.220 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:14:23.403 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:14:23.403 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:14:28.404 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:28.404 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:28.405 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:14:28.584 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:14:28.585 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:14:33.586 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:33.916 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:33.916 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:14:34.099 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:14:34.099 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:14:39.100 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:39.100 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:39.101 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:14:39.282 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:14:39.282 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:14:44.283 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:44.283 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:44.283 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:14:44.465 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:14:44.465 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:14:49.466 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:49.466 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:49.467 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:14:49.642 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:14:49.642 WARNING:rgw_multi.tests:bucket fggivf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:14:54.649 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_object_sync ... FAIL 2021-02-13T17:14:54.649 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-13 2021-02-13T17:14:54.735 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-14 2021-02-13T17:14:54.842 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=fggivf-15 2021-02-13T17:14:55.120 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:55.120 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:55.120 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:14:55.225 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=efc2d01e-ebf2-4522-b313-ef15a0018fb0 2021-02-13T17:14:55.242 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"1_1613236014.104172_63.1","last_update":"2021-02-13 17:06:54.104172Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613236494.899000_82.1","last_update":"2021-02-13 17:14:54.899000Z"},{"marker":"1_1613236165.569853_155.1","last_update":"2021-02-13 17:09:25.569853Z"}] 2021-02-13T17:14:55.242 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:14:55.243 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:55.243 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:14:55.243 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:14:55.335 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613236171.401277_64.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:31.401277Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:14:55.336 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613236494.899000_82.1 target=1_1613236171.401277_64.1 2021-02-13T17:15:00.336 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:00.337 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:00.337 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:00.416 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613236494.899000_82.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:14:54.899000Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:15:00.417 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:15:00.417 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:15:00.417 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:00.417 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:00.417 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:00.504 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613236494.899000_82.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:14:54.899000Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:15:00.505 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:15:00.505 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:15:00.505 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:00.505 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:00.505 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:00.681 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613236494.899000_82.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:14:54.899000Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:15:00.681 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:15:00.682 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:00.682 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:00.682 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:00.761 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000002.3.5"}]} 2021-02-13T17:15:00.761 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-13 2021-02-13T17:15:00.762 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:00.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:00.762 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:00.846 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.3.5"}}}] 2021-02-13T17:15:00.846 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-13 2021-02-13T17:15:00.846 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-13 zones={test-zone2, test-zone1} 2021-02-13T17:15:00.852 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:15:00.895 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:15:00.895 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:15:00.900 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:15:00.952 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:15:01.014 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:15:01.123 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:15:01.231 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-13 zones={test-zone2, test-zone1} 2021-02-13T17:15:01.231 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:01.231 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:01.231 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:01.311 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000002.3.5"}]} 2021-02-13T17:15:01.311 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-13 2021-02-13T17:15:01.312 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:01.312 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:01.312 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:01.393 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.3.5"}}}] 2021-02-13T17:15:01.394 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-13 2021-02-13T17:15:01.394 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-13 zones={test-zone3, test-zone1} 2021-02-13T17:15:01.398 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:15:01.443 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:15:01.443 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:15:01.448 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:15:01.551 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:15:01.614 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:15:01.735 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:15:01.844 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-13 zones={test-zone3, test-zone1} 2021-02-13T17:15:01.844 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:01.844 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:01.844 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:01.960 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000002.3.5"}]} 2021-02-13T17:15:01.961 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-13 2021-02-13T17:15:01.961 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:01.961 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:01.961 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:02.146 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.3.5"}}}] 2021-02-13T17:15:02.147 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-13 2021-02-13T17:15:02.147 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:02.147 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:02.148 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:02.235 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000002.2.5"}]} 2021-02-13T17:15:02.235 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-14 2021-02-13T17:15:02.235 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:02.236 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:02.236 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:02.320 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.2.5"}}}] 2021-02-13T17:15:02.320 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-14 2021-02-13T17:15:02.321 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-14 zones={test-zone1, test-zone2} 2021-02-13T17:15:02.326 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:15:02.375 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:15:02.375 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:15:02.380 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:15:02.436 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:15:02.496 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:15:02.612 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:15:02.717 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-14 zones={test-zone1, test-zone2} 2021-02-13T17:15:02.717 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:02.717 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:02.718 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:02.803 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000002.2.5"}]} 2021-02-13T17:15:02.804 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-14 2021-02-13T17:15:02.804 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:02.804 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:02.804 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:02.891 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.2.5"}}}] 2021-02-13T17:15:02.891 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-14 2021-02-13T17:15:02.891 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-14 zones={test-zone3, test-zone2} 2021-02-13T17:15:02.897 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:15:02.947 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:15:02.947 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:15:02.953 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:15:03.047 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:15:03.107 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:15:03.219 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:15:03.327 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-14 zones={test-zone3, test-zone2} 2021-02-13T17:15:03.327 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:03.327 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:03.328 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:03.450 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000002.2.5"}]} 2021-02-13T17:15:03.451 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-14 2021-02-13T17:15:03.451 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:03.451 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:03.451 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:03.625 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:15:03.626 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:15:08.627 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:08.628 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:08.628 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:08.803 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:15:08.804 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:15:13.804 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:13.805 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:13.805 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:13.995 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:15:13.995 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:15:18.996 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:18.996 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:18.997 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:19.172 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:15:19.173 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:15:24.174 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:24.175 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:24.175 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:24.352 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:15:24.352 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:15:29.353 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:29.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:29.354 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:29.529 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:15:29.529 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:15:34.530 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:34.530 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:34.531 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:34.711 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:15:34.712 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:15:39.713 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:39.713 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:39.713 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:39.894 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:15:39.895 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:15:44.895 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:44.895 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:44.896 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:45.070 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:15:45.070 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:15:50.071 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:50.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:50.072 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:50.245 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:15:50.246 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:15:55.247 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:55.247 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:15:55.247 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:15:55.421 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:15:55.421 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:16:00.422 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:00.422 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:00.423 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:16:00.642 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:16:00.642 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:16:05.643 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:05.643 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:05.644 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:16:05.818 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:16:05.819 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:16:10.819 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:10.819 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:10.820 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:16:10.993 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:16:10.993 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:16:15.994 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:15.995 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:15.995 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:16:16.177 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:16:16.177 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:16:21.178 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:21.178 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:21.179 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:16:21.353 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:16:21.354 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:16:26.355 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:26.355 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:26.356 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:16:26.530 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:16:26.531 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:16:31.532 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:31.532 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:31.532 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:16:31.709 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:16:31.709 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:16:36.711 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:36.711 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:36.712 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:16:36.896 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:16:36.896 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:16:41.897 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:41.897 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:41.898 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:16:42.080 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:16:42.081 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:16:47.081 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:47.082 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:47.082 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:16:47.256 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:16:47.256 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:16:52.257 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:52.257 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:52.258 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:16:52.436 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:16:52.437 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:16:57.437 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:57.438 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:16:57.438 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:16:57.618 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:16:57.618 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:17:02.619 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:02.620 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:02.620 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:17:02.800 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:17:02.800 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:17:07.801 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:07.801 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:07.801 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:17:07.982 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:17:07.983 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:17:12.983 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:12.983 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:12.984 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:17:13.160 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:17:13.161 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:17:18.162 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:18.162 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:18.162 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:17:18.332 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:17:18.333 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:17:23.333 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:23.334 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:23.334 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:17:23.515 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:17:23.516 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:17:28.516 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:28.517 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:28.517 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:17:28.701 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:17:28.701 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:17:33.702 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:33.702 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:33.702 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:17:33.880 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:17:33.881 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:17:38.882 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:38.882 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:38.883 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:17:39.063 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:17:39.064 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:17:44.064 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:44.065 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:44.065 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:17:44.240 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:17:44.241 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:17:49.242 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:49.242 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:49.242 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:17:49.421 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:17:49.422 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:17:54.422 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:54.422 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:54.423 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:17:54.598 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:17:54.599 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:17:59.600 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:59.600 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:17:59.600 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:17:59.770 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:17:59.771 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:18:04.772 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:04.772 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:04.772 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:18:04.948 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:18:04.948 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:18:09.950 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:09.950 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:09.950 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:18:10.131 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:18:10.131 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:18:15.133 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:15.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:15.133 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:18:15.313 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:18:15.314 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:18:20.314 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:20.315 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:20.315 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:18:20.498 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:18:20.498 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:18:25.499 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:25.499 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:25.499 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:18:25.669 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:18:25.670 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:18:30.671 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:30.671 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:30.671 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:18:30.853 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:18:30.853 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:18:35.854 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:35.854 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:35.854 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:18:36.036 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:18:36.037 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:18:41.038 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:41.038 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:41.038 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:18:41.221 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:18:41.221 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:18:46.222 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:46.223 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:46.223 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:18:46.403 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:18:46.403 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:18:51.404 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:51.404 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:51.405 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:18:51.583 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:18:51.583 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:18:56.584 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:56.585 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:18:56.585 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:18:56.766 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:18:56.766 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:19:01.767 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:01.768 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:01.768 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:19:01.949 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:19:01.949 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:19:06.950 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:06.950 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:06.950 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:19:07.126 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:19:07.127 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:19:12.128 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:12.128 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:12.129 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:19:12.305 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:19:12.305 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:19:17.306 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:17.306 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:17.307 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:19:17.488 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:19:17.489 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:19:22.490 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:22.490 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:22.490 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:19:22.669 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:19:22.670 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:19:27.671 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:27.671 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:27.671 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:19:27.850 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:19:27.851 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:19:32.851 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:32.852 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:32.852 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:19:33.034 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:19:33.034 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:19:38.035 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:38.035 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:38.036 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:19:38.212 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:19:38.212 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:19:43.213 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:43.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:43.214 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:19:43.387 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:19:43.388 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:19:48.389 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:48.389 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:48.390 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:19:48.565 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:19:48.565 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:19:53.566 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:53.566 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:53.567 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:19:53.783 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:19:53.784 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:19:58.785 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:58.785 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:19:58.785 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:19:58.968 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:19:58.968 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:20:03.969 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:03.969 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:03.970 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:04.147 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:20:04.147 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:20:09.148 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:09.148 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:09.149 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:09.328 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:20:09.329 WARNING:rgw_multi.tests:bucket fggivf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.2.5 target= 2021-02-13T17:20:14.331 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_object_delete ... FAIL 2021-02-13T17:20:14.331 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-16 2021-02-13T17:20:14.403 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-17 2021-02-13T17:20:14.533 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=fggivf-18 2021-02-13T17:20:14.735 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:14.735 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:14.736 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:14.837 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=efc2d01e-ebf2-4522-b313-ef15a0018fb0 2021-02-13T17:20:14.853 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"1_1613236014.104172_63.1","last_update":"2021-02-13 17:06:54.104172Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613236814.717897_115.1","last_update":"2021-02-13 17:20:14.717897Z"},{"marker":"1_1613236165.569853_155.1","last_update":"2021-02-13 17:09:25.569853Z"}] 2021-02-13T17:20:14.853 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:20:14.854 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:14.854 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:14.854 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:14.938 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613236494.899000_82.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:14:54.899000Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:20:14.939 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613236814.717897_115.1 target=1_1613236494.899000_82.1 2021-02-13T17:20:19.939 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:19.940 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:19.940 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:20.024 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613236814.717897_115.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:20:14.717897Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:20:20.024 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:20:20.025 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:20:20.025 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:20.025 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:20.025 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:20.103 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613236814.717897_115.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:20:14.717897Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:20:20.103 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:20:20.103 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:20:20.103 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:20.104 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:20.104 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:20.282 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613236814.717897_115.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:20:14.717897Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:20:20.283 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:20:20.340 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:20.340 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:20.340 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-16 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:20.452 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000003.7.10"}]} 2021-02-13T17:20:20.452 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-16 2021-02-13T17:20:20.452 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:20.453 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:20.453 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-16 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:20.544 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:20:20.545 WARNING:rgw_multi.tests:bucket fggivf-16 zone test-zone2 behind zone test-zone1: shard=0 master=00000000003.7.10 target= 2021-02-13T17:20:25.545 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:25.546 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:25.546 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-16 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:25.634 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"mYhEzgU2ahTN9I5BFzJQhfkm-pTaKSH","ns":""},"count":1},"inc_marker":{"position":"00000000007.13.9"}}}] 2021-02-13T17:20:25.634 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-16 2021-02-13T17:20:25.634 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:25.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:25.635 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-16 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:25.719 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000007.13.9"}]} 2021-02-13T17:20:25.720 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-16 2021-02-13T17:20:25.720 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:25.720 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:25.720 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-16 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:25.801 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"mYhEzgU2ahTN9I5BFzJQhfkm-pTaKSH","ns":""},"count":1},"inc_marker":{"position":"00000000007.13.9"}}}] 2021-02-13T17:20:25.802 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-16 2021-02-13T17:20:25.802 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:25.802 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:25.802 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-16 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:25.902 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000007.13.9"}]} 2021-02-13T17:20:25.903 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-16 2021-02-13T17:20:25.903 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:25.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:25.903 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-16 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:26.082 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"mYhEzgU2ahTN9I5BFzJQhfkm-pTaKSH","ns":""},"count":1},"inc_marker":{"position":"00000000007.13.9"}}}] 2021-02-13T17:20:26.082 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-16 2021-02-13T17:20:26.127 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:26.127 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:26.127 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:26.209 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000003.5.10"}]} 2021-02-13T17:20:26.210 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-17 2021-02-13T17:20:26.210 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:26.210 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:26.210 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:26.296 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:20:26.296 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone1 behind zone test-zone2: shard=0 master=00000000003.5.10 target= 2021-02-13T17:20:31.297 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:31.298 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:31.298 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:31.384 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"ZtMX50nWkjDz2SCwYX36eGR7c3XnoNO","ns":""},"count":1},"inc_marker":{"position":"00000000005.9.9"}}}] 2021-02-13T17:20:31.385 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-17 2021-02-13T17:20:31.385 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:31.385 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:31.385 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:31.469 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000005.9.9"}]} 2021-02-13T17:20:31.469 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-17 2021-02-13T17:20:31.470 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:31.470 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:31.470 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:31.563 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"ZtMX50nWkjDz2SCwYX36eGR7c3XnoNO","ns":""},"count":1},"inc_marker":{"position":"00000000005.9.9"}}}] 2021-02-13T17:20:31.563 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-17 2021-02-13T17:20:31.564 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:31.564 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:31.564 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:31.651 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000005.9.9"}]} 2021-02-13T17:20:31.651 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-17 2021-02-13T17:20:31.652 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:31.652 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:31.652 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:31.832 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:20:31.832 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:20:36.833 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:36.833 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:36.833 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:37.014 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:20:37.015 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:20:42.015 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:42.015 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:42.016 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:42.196 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:20:42.196 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:20:47.197 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:47.198 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:47.198 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:47.378 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:20:47.378 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:20:52.379 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:52.379 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:52.380 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:52.556 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:20:52.556 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:20:57.557 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:57.557 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:20:57.558 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:20:57.741 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:20:57.741 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:21:02.742 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:02.742 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:02.743 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:21:02.917 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:21:02.918 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:21:07.919 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:07.919 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:07.919 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:21:08.095 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:21:08.095 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:21:13.096 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:13.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:13.096 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:21:13.278 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:21:13.278 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:21:18.279 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:18.280 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:18.280 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:21:18.461 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:21:18.461 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:21:23.463 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:23.463 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:23.463 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:21:23.651 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:21:23.651 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:21:28.652 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:28.653 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:28.653 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:21:28.830 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:21:28.831 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:21:33.832 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:33.832 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:33.833 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:21:34.017 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:21:34.017 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:21:39.018 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:39.019 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:39.019 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:21:39.199 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:21:39.199 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:21:44.200 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:44.201 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:44.201 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:21:44.375 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:21:44.375 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:21:49.376 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:49.376 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:49.376 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:21:49.596 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:21:49.596 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:21:54.597 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:54.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:54.597 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:21:54.772 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:21:54.773 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:21:59.773 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:59.774 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:21:59.774 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:21:59.951 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:21:59.951 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:22:04.952 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:04.953 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:04.953 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:22:05.127 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:22:05.127 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:22:10.128 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:10.128 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:10.128 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:22:10.307 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:22:10.307 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:22:15.308 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:15.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:15.308 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:22:15.483 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:22:15.483 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:22:20.484 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:20.484 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:20.485 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:22:20.669 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:22:20.669 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:22:25.670 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:25.671 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:25.671 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:22:25.847 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:22:25.847 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:22:30.849 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:30.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:30.849 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:22:31.032 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:22:31.033 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:22:36.033 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:36.033 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:36.034 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:22:36.215 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:22:36.216 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:22:41.217 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:41.217 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:41.218 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:22:41.401 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:22:41.401 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:22:46.402 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:46.402 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:46.403 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:22:46.583 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:22:46.584 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:22:51.585 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:51.585 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:51.586 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:22:51.756 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:22:51.757 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:22:56.758 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:56.758 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:22:56.758 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:22:56.934 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:22:56.934 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:23:01.935 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:01.936 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:01.936 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:23:02.118 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:23:02.118 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:23:07.119 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:07.119 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:07.119 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:23:07.305 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:23:07.305 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:23:12.306 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:12.306 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:12.306 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:23:12.487 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:23:12.488 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:23:17.489 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:17.489 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:17.489 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:23:17.669 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:23:17.670 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:23:22.670 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:22.671 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:22.671 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:23:22.847 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:23:22.847 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:23:27.847 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:27.848 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:27.848 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:23:28.021 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:23:28.021 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:23:33.022 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:33.022 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:33.023 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:23:33.204 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:23:33.204 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:23:38.205 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:38.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:38.206 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:23:38.389 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:23:38.390 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:23:43.390 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:43.390 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:43.391 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:23:43.571 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:23:43.572 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:23:48.572 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:48.573 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:48.573 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:23:48.753 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:23:48.754 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:23:53.754 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:53.755 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:53.755 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:23:53.937 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:23:53.937 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:23:58.938 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:58.938 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:23:58.939 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:23:59.113 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:23:59.113 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:24:04.114 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:04.114 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:04.114 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:24:04.288 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:24:04.288 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:24:09.289 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:09.289 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:09.290 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:24:09.473 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:24:09.474 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:24:14.475 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:14.475 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:14.475 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:24:14.653 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:24:14.653 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:24:19.654 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:19.655 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:19.655 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:24:19.829 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:24:19.829 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:24:24.830 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:24.830 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:24.830 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:24:25.012 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:24:25.012 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:24:30.013 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:30.013 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:30.013 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:24:30.185 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:24:30.185 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:24:35.185 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:35.186 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:35.186 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:24:35.366 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:24:35.367 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:24:40.368 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:40.368 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:40.368 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:24:40.551 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:24:40.551 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:24:45.552 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:45.553 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:45.553 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:24:45.734 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:24:45.734 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:24:50.735 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:50.735 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:50.736 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:24:50.915 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:24:50.915 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:24:55.916 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:55.916 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:24:55.916 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:24:56.099 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:24:56.099 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:25:01.100 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:01.100 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:01.101 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:01.284 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:25:01.285 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:25:06.285 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:06.285 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:06.286 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:06.461 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:25:06.462 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:25:11.463 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:11.463 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:11.463 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:11.645 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:25:11.646 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:25:16.647 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:16.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:16.647 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:16.821 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:25:16.821 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:25:21.822 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:21.822 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:21.822 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:22.008 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:25:22.008 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:25:27.009 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:27.009 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:27.009 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:27.189 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:25:27.189 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:25:32.189 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:32.192 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:32.192 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:32.376 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:25:32.376 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:25:37.377 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:37.378 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:37.378 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:37.596 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:25:37.596 WARNING:rgw_multi.tests:bucket fggivf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.9.9 target= 2021-02-13T17:25:42.598 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_versioned_object_incremental_sync ... FAIL 2021-02-13T17:25:42.698 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:42.698 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:42.699 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:42.799 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=efc2d01e-ebf2-4522-b313-ef15a0018fb0 2021-02-13T17:25:42.814 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"1_1613236014.104172_63.1","last_update":"2021-02-13 17:06:54.104172Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613237142.691994_126.1","last_update":"2021-02-13 17:25:42.691994Z"},{"marker":"1_1613236165.569853_155.1","last_update":"2021-02-13 17:09:25.569853Z"}] 2021-02-13T17:25:42.814 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:25:42.815 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:42.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:42.815 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:42.895 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613236814.717897_115.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:20:14.717897Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:25:42.895 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613237142.691994_126.1 target=1_1613236814.717897_115.1 2021-02-13T17:25:47.896 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:47.896 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:47.896 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:47.982 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613237142.691994_126.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:25:42.691994Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:25:47.982 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:25:47.982 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:25:47.983 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:47.983 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:47.983 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:48.066 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613237142.691994_126.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:25:42.691994Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:25:48.067 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:25:48.067 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:25:48.067 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:48.067 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:48.067 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:48.242 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613237142.691994_126.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:25:42.691994Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:25:48.242 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:25:48.298 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:48.298 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:48.298 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-19 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:48.412 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000003.3.10"}]} 2021-02-13T17:25:48.412 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-19 2021-02-13T17:25:48.413 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:48.413 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:48.413 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:48.539 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:25:48.539 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone2 behind zone test-zone1: shard=0 master=00000000003.3.10 target= 2021-02-13T17:25:53.540 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:53.540 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:53.540 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:53.666 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"gy7R.sEtDqRvefVUUT9.zwpJB0fB351","ns":""},"count":1},"inc_marker":{"position":"00000000007.9.9"}}}] 2021-02-13T17:25:53.666 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-19 2021-02-13T17:25:53.666 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:53.666 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:53.667 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-19 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:53.752 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000007.9.9"}]} 2021-02-13T17:25:53.752 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-19 2021-02-13T17:25:53.752 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:53.752 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:53.753 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-19 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:53.834 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"gy7R.sEtDqRvefVUUT9.zwpJB0fB351","ns":""},"count":1},"inc_marker":{"position":"00000000007.9.9"}}}] 2021-02-13T17:25:53.834 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-19 2021-02-13T17:25:53.835 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:53.835 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:53.835 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-19 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:53.931 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000007.9.9"}]} 2021-02-13T17:25:53.931 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-19 2021-02-13T17:25:53.931 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:53.931 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:53.931 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:54.111 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"gy7R.sEtDqRvefVUUT9.zwpJB0fB351","ns":""},"count":1},"inc_marker":{"position":"00000000007.9.9"}}}] 2021-02-13T17:25:54.111 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-19 2021-02-13T17:25:54.111 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:54.112 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:54.112 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:54.234 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000005.8.9"}]} 2021-02-13T17:25:54.234 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-19 2021-02-13T17:25:54.234 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:54.234 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:54.235 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:54.360 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"gy7R.sEtDqRvefVUUT9.zwpJB0fB351","ns":""},"count":1},"inc_marker":{"position":"00000000005.8.9"}}}] 2021-02-13T17:25:54.361 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-19 2021-02-13T17:25:54.361 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:54.361 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:54.362 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:54.481 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000005.8.9"}]} 2021-02-13T17:25:54.482 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-19 2021-02-13T17:25:54.482 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:54.482 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:54.482 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:54.610 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"gy7R.sEtDqRvefVUUT9.zwpJB0fB351","ns":""},"count":1},"inc_marker":{"position":"00000000005.8.9"}}}] 2021-02-13T17:25:54.610 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-19 2021-02-13T17:25:54.610 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:54.610 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:54.611 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:54.732 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000005.8.9"}]} 2021-02-13T17:25:54.733 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-19 2021-02-13T17:25:54.733 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:54.733 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:54.733 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:25:54.913 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:25:54.914 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:25:59.914 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:59.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:25:59.915 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:26:00.086 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:26:00.087 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:26:05.087 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:05.088 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:05.088 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:26:05.262 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:26:05.262 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:26:10.263 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:10.263 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:10.264 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:26:10.447 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:26:10.447 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:26:15.448 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:15.448 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:15.448 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:26:15.630 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:26:15.630 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:26:20.631 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:20.631 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:20.631 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:26:20.808 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:26:20.809 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:26:25.809 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:25.810 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:25.810 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:26:25.985 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:26:25.985 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:26:30.986 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:30.986 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:30.987 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:26:31.169 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:26:31.169 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:26:36.170 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:36.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:36.171 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:26:36.354 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:26:36.355 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:26:41.355 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:41.356 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:41.356 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:26:41.531 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:26:41.532 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:26:46.532 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:46.533 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:46.533 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:26:46.713 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:26:46.714 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:26:51.715 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:51.715 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:51.715 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:26:51.891 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:26:51.891 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:26:56.891 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:56.892 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:26:56.892 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:26:57.071 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:26:57.072 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:27:02.073 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:02.073 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:02.074 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:27:02.254 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:27:02.255 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:27:07.256 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:07.256 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:07.256 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:27:07.439 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:27:07.439 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:27:12.439 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:12.440 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:12.440 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:27:12.623 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:27:12.624 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:27:17.625 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:17.625 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:17.625 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:27:17.804 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:27:17.805 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:27:22.805 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:22.805 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:22.806 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:27:22.998 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:27:22.999 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:27:28.000 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:28.000 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:28.000 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:27:28.175 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:27:28.176 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:27:33.177 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:33.177 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:33.177 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:27:33.353 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:27:33.353 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:27:38.355 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:38.355 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:38.355 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:27:38.539 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:27:38.539 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:27:43.540 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:43.540 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:43.540 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:27:43.721 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:27:43.721 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:27:48.722 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:48.723 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:48.723 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:27:48.906 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:27:48.906 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:27:53.907 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:53.907 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:53.907 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:27:54.091 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:27:54.091 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:27:59.092 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:59.092 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:27:59.093 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:27:59.269 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:27:59.270 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:28:04.270 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:04.271 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:04.271 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:28:04.451 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:28:04.452 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:28:09.452 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:09.452 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:09.453 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:28:09.630 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:28:09.630 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:28:14.631 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:14.631 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:14.632 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:28:14.807 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:28:14.807 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:28:19.809 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:19.809 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:19.809 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:28:19.986 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:28:19.987 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:28:24.988 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:24.988 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:24.988 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:28:25.164 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:28:25.165 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:28:30.166 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:30.166 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:30.166 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:28:30.343 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:28:30.343 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:28:35.344 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:35.344 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:35.344 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:28:35.521 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:28:35.521 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:28:40.522 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:40.522 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:40.522 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:28:40.707 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:28:40.707 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:28:45.708 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:45.709 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:45.709 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:28:45.892 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:28:45.893 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:28:50.894 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:50.894 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:50.895 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:28:51.076 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:28:51.077 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:28:56.078 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:56.078 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:28:56.078 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:28:56.261 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:28:56.262 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:29:01.263 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:01.263 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:01.263 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:29:01.441 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:29:01.441 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:29:06.442 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:06.442 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:06.442 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:29:06.625 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:29:06.626 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:29:11.626 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:11.626 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:11.627 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:29:11.811 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:29:11.811 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:29:16.812 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:16.812 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:16.813 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:29:16.997 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:29:16.997 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:29:21.998 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:21.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:21.999 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:29:22.180 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:29:22.180 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:29:27.181 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:27.181 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:27.181 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:29:27.357 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:29:27.358 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:29:32.358 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:32.359 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:32.359 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:29:32.535 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:29:32.536 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:29:37.536 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:37.536 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:37.537 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:29:37.719 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:29:37.720 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:29:42.721 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:42.721 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:42.721 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:29:42.898 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:29:42.899 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:29:47.900 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:47.900 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:47.901 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:29:48.085 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:29:48.085 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:29:53.087 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:53.087 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:53.087 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:29:53.264 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:29:53.265 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:29:58.266 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:58.266 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:29:58.267 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:29:58.450 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:29:58.450 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:30:03.451 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:03.451 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:03.452 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:30:03.634 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:30:03.635 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:30:08.636 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:08.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:08.636 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:30:08.814 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:30:08.814 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:30:13.816 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:13.816 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:13.816 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:30:14.000 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:30:14.000 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:30:19.001 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:19.002 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:19.002 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:30:19.180 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:30:19.181 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:30:24.181 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:24.182 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:24.182 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:30:24.358 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:30:24.359 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:30:29.360 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:29.360 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:29.360 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:30:29.536 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:30:29.537 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:30:34.538 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:34.538 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:34.538 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:30:34.720 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:30:34.721 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:30:39.722 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:39.722 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:39.722 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:30:39.906 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:30:39.906 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:30:44.908 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:44.908 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:44.908 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:30:45.093 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:30:45.094 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:30:50.095 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:50.095 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:50.095 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:30:50.275 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:30:50.275 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:30:55.277 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:55.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:30:55.277 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:30:55.463 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:30:55.463 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:31:00.464 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:00.465 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:00.465 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:00.650 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:31:00.651 WARNING:rgw_multi.tests:bucket fggivf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T17:31:05.653 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_concurrent_versioned_object_incremental_sync ... FAIL 2021-02-13T17:31:05.717 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:05.718 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:05.718 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:05.816 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=efc2d01e-ebf2-4522-b313-ef15a0018fb0 2021-02-13T17:31:05.831 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"1_1613236014.104172_63.1","last_update":"2021-02-13 17:06:54.104172Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613237465.705456_146.1","last_update":"2021-02-13 17:31:05.705456Z"},{"marker":"1_1613236165.569853_155.1","last_update":"2021-02-13 17:09:25.569853Z"}] 2021-02-13T17:31:05.832 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:31:05.832 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:05.832 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:05.832 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:05.920 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613237142.691994_126.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:25:42.691994Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:31:05.920 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613237465.705456_146.1 target=1_1613237142.691994_126.1 2021-02-13T17:31:10.921 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:10.922 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:10.922 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:11.005 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613237465.705456_146.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:31:05.705456Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:31:11.006 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:31:11.006 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:31:11.006 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:11.006 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:11.006 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:11.088 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613237465.705456_146.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:31:05.705456Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:31:11.088 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:31:11.089 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:31:11.089 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:11.089 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:11.089 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:11.306 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613237465.705456_146.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:31:05.705456Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:31:11.307 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:31:11.359 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:11.359 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:11.359 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-20 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:11.478 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000002.3.5"}]} 2021-02-13T17:31:11.478 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-20 2021-02-13T17:31:11.479 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:11.479 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:11.479 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:11.604 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:31:11.604 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone2 behind zone test-zone1: shard=0 master=00000000002.3.5 target= 2021-02-13T17:31:16.605 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:16.605 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:16.606 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:16.696 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.3.5"}}}] 2021-02-13T17:31:16.697 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-20 2021-02-13T17:31:16.697 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:16.697 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:16.697 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-20 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:16.782 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000002.3.5"}]} 2021-02-13T17:31:16.783 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-20 2021-02-13T17:31:16.783 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:16.783 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:16.783 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-20 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:16.874 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.3.5"}}}] 2021-02-13T17:31:16.874 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-20 2021-02-13T17:31:16.874 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:16.875 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:16.875 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-20 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:16.981 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000002.3.5"}]} 2021-02-13T17:31:16.982 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-20 2021-02-13T17:31:16.982 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:16.982 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:16.983 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:17.164 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.3.5"}}}] 2021-02-13T17:31:17.164 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-20 2021-02-13T17:31:17.164 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:17.165 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:17.165 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:17.249 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000002.5.5"}]} 2021-02-13T17:31:17.250 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-20 2021-02-13T17:31:17.250 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:17.250 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:17.250 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:17.374 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.5.5"}}}] 2021-02-13T17:31:17.375 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-20 2021-02-13T17:31:17.375 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:17.375 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:17.376 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:17.502 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000002.5.5"}]} 2021-02-13T17:31:17.502 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-20 2021-02-13T17:31:17.503 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:17.503 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:17.503 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:17.592 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.5.5"}}}] 2021-02-13T17:31:17.593 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-20 2021-02-13T17:31:17.593 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:17.593 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:17.593 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:17.716 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000002.5.5"}]} 2021-02-13T17:31:17.717 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-20 2021-02-13T17:31:17.717 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:17.717 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:17.717 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:17.892 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:31:17.893 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:31:22.893 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:22.894 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:22.894 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:23.074 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:31:23.075 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:31:28.075 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:28.076 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:28.076 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:28.259 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:31:28.259 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:31:33.260 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:33.260 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:33.261 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:33.439 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:31:33.439 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:31:38.440 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:38.440 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:38.440 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:38.622 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:31:38.622 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:31:43.623 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:43.623 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:43.623 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:43.800 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:31:43.801 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:31:48.802 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:48.837 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:48.837 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:49.015 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:31:49.015 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:31:54.016 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:54.017 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:54.017 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:54.203 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:31:54.203 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:31:59.204 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:59.205 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:31:59.205 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:31:59.381 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:31:59.382 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:32:04.383 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:04.383 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:04.384 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:32:04.566 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:32:04.566 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:32:09.567 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:09.567 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:09.568 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:32:09.751 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:32:09.751 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:32:14.752 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:14.753 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:14.753 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:32:14.937 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:32:14.937 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:32:19.938 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:19.939 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:19.939 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:32:20.122 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:32:20.123 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:32:25.124 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:25.124 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:25.125 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:32:25.305 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:32:25.305 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:32:30.306 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:30.306 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:30.306 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:32:30.487 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:32:30.488 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:32:35.489 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:35.489 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:35.489 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:32:35.671 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:32:35.671 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:32:40.672 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:40.672 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:40.673 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:32:40.857 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:32:40.858 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:32:45.858 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:45.859 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:45.859 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:32:46.043 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:32:46.043 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:32:51.047 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:51.048 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:51.048 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:32:51.230 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:32:51.231 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:32:56.232 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:56.232 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:32:56.233 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:32:56.411 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:32:56.411 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:33:01.412 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:01.412 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:01.413 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:33:01.596 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:33:01.597 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:33:06.597 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:06.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:06.598 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:33:06.780 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:33:06.781 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:33:11.782 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:11.782 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:11.782 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:33:11.958 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:33:11.958 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:33:16.959 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:16.959 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:16.960 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:33:17.143 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:33:17.143 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:33:22.144 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:22.144 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:22.145 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:33:22.327 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:33:22.328 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:33:27.329 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:27.329 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:27.329 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:33:27.506 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:33:27.506 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:33:32.507 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:32.507 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:32.508 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:33:32.688 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:33:32.688 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:33:37.690 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:37.690 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:37.691 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:33:37.867 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:33:37.867 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:33:42.868 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:42.868 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:42.868 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:33:43.051 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:33:43.052 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:33:48.053 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:48.053 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:48.053 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:33:48.236 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:33:48.237 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:33:53.238 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:53.238 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:53.239 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:33:53.424 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:33:53.425 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:33:58.425 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:58.426 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:33:58.426 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:33:58.609 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:33:58.609 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:34:03.610 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:03.611 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:03.611 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:34:03.787 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:34:03.787 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:34:08.788 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:08.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:08.788 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:34:08.965 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:34:08.965 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:34:13.966 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:13.967 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:13.967 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:34:14.151 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:34:14.151 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:34:19.153 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:19.153 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:19.153 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:34:19.338 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:34:19.338 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:34:24.339 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:24.339 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:24.339 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:34:24.524 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:34:24.524 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:34:29.525 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:29.525 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:29.525 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:34:29.711 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:34:29.711 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:34:34.712 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:34.712 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:34.713 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:34:34.894 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:34:34.894 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:34:39.895 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:39.896 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:39.896 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:34:40.075 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:34:40.076 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:34:45.077 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:45.077 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:45.077 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:34:45.264 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:34:45.265 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:34:50.266 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:50.266 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:50.266 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:34:50.444 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:34:50.445 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:34:55.445 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:55.445 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:34:55.446 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:34:55.628 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:34:55.629 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:35:00.630 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:00.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:00.630 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:35:00.813 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:35:00.813 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:35:05.814 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:05.814 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:05.815 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:35:05.993 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:35:05.993 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:35:10.994 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:10.994 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:10.994 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:35:11.177 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:35:11.177 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:35:16.178 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:16.179 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:16.179 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:35:16.361 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:35:16.362 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:35:21.363 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:21.363 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:21.364 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:35:21.539 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:35:21.540 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:35:26.541 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:26.541 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:26.541 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:35:26.713 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:35:26.714 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:35:31.714 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:31.715 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:31.715 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:35:31.894 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:35:31.894 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:35:36.894 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:36.895 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:36.895 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:35:37.075 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:35:37.075 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:35:42.076 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:42.077 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:42.077 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:35:42.259 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:35:42.260 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:35:47.261 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:47.261 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:47.262 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:35:47.443 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:35:47.444 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:35:52.445 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:52.445 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:52.446 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:35:52.622 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:35:52.623 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:35:57.623 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:57.624 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:35:57.624 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:35:57.802 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:35:57.846 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:36:02.847 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:02.847 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:02.848 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:03.023 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:36:03.023 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:36:08.024 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:08.024 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:08.025 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:08.210 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:36:08.211 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:36:13.211 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:13.211 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:13.212 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:13.394 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:36:13.395 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:36:18.396 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:18.396 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:18.396 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:18.571 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:36:18.571 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:36:23.573 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:23.573 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:23.573 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:23.743 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:36:23.743 WARNING:rgw_multi.tests:bucket fggivf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.5.5 target= 2021-02-13T17:36:28.745 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_version_suspended_incremental_sync ... FAIL 2021-02-13T17:36:28.746 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-21 2021-02-13T17:36:28.809 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-22 2021-02-13T17:36:28.917 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=fggivf-23 2021-02-13T17:36:29.125 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:29.125 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:29.125 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:29.225 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=efc2d01e-ebf2-4522-b313-ef15a0018fb0 2021-02-13T17:36:29.239 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"1_1613236014.104172_63.1","last_update":"2021-02-13 17:06:54.104172Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613237789.107690_169.1","last_update":"2021-02-13 17:36:29.107690Z"},{"marker":"1_1613236165.569853_155.1","last_update":"2021-02-13 17:09:25.569853Z"}] 2021-02-13T17:36:29.239 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:36:29.240 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:29.240 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:29.240 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:29.323 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613237465.705456_146.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:31:05.705456Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:36:29.324 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613237789.107690_169.1 target=1_1613237465.705456_146.1 2021-02-13T17:36:34.325 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:34.325 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:34.326 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:34.402 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613237789.107690_169.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:36:29.107690Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:36:34.402 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:36:34.402 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:36:34.402 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:34.402 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:34.403 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:34.491 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613237789.107690_169.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:36:29.107690Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:36:34.491 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:36:34.492 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:36:34.492 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:34.492 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:34.492 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:34.663 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613237789.107690_169.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:36:29.107690Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:36:34.663 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:36:34.943 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:34.943 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:34.943 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-21 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:35.059 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000004.20.11"}]} 2021-02-13T17:36:35.060 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-21 2021-02-13T17:36:35.060 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:35.060 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:35.060 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:35.187 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:36:35.187 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone2 behind zone test-zone1: shard=0 master=00000000004.20.11 target= 2021-02-13T17:36:40.189 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:40.189 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:40.189 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:40.283 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"m1Xt5ZXsIDcIzHYB6.ziq1pzDC4Qcy0","ns":""},"count":2},"inc_marker":{"position":"0#00000000004.20.11"}}}] 2021-02-13T17:36:40.284 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-21 2021-02-13T17:36:40.284 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:40.284 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:40.284 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-21 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:40.372 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000004.20.11"}]} 2021-02-13T17:36:40.372 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-21 2021-02-13T17:36:40.372 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:40.372 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:40.372 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-21 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:40.454 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"m1Xt5ZXsIDcIzHYB6.ziq1pzDC4Qcy0","ns":""},"count":2},"inc_marker":{"position":"0#00000000004.20.11"}}}] 2021-02-13T17:36:40.454 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-21 2021-02-13T17:36:40.454 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:40.454 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:40.455 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-21 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:40.536 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000004.20.11"}]} 2021-02-13T17:36:40.536 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-21 2021-02-13T17:36:40.536 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:40.537 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:40.537 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:40.755 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"m1Xt5ZXsIDcIzHYB6.ziq1pzDC4Qcy0","ns":""},"count":2},"inc_marker":{"position":"0#00000000004.20.11"}}}] 2021-02-13T17:36:40.756 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-21 2021-02-13T17:36:40.756 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:40.756 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:40.756 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:40.838 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000003.18.5"}]} 2021-02-13T17:36:40.839 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-21 2021-02-13T17:36:40.839 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:40.839 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:40.839 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:40.923 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"m1Xt5ZXsIDcIzHYB6.ziq1pzDC4Qcy0","ns":""},"count":2},"inc_marker":{"position":"0#00000000003.18.5"}}}] 2021-02-13T17:36:40.923 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-21 2021-02-13T17:36:40.924 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:40.924 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:40.924 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:41.046 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000003.18.5"}]} 2021-02-13T17:36:41.047 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-21 2021-02-13T17:36:41.047 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:41.047 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:41.047 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:41.139 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"m1Xt5ZXsIDcIzHYB6.ziq1pzDC4Qcy0","ns":""},"count":2},"inc_marker":{"position":"0#00000000003.18.5"}}}] 2021-02-13T17:36:41.139 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-21 2021-02-13T17:36:41.139 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:41.139 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:41.139 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:41.259 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000003.18.5"}]} 2021-02-13T17:36:41.259 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-21 2021-02-13T17:36:41.259 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:41.259 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:41.260 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:41.442 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:36:41.442 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:36:46.443 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:46.444 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:46.444 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:46.629 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:36:46.629 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:36:51.630 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:51.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:51.630 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:51.815 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:36:51.815 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:36:56.817 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:56.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:36:56.817 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:36:56.993 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:36:56.993 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:37:01.994 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:01.994 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:01.995 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:37:02.181 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:37:02.181 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:37:07.182 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:07.183 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:07.183 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:37:07.359 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:37:07.359 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:37:12.360 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:12.361 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:12.361 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:37:12.536 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:37:12.537 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:37:17.538 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:17.538 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:17.543 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:37:17.721 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:37:17.722 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:37:22.723 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:22.723 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:22.724 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:37:22.902 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:37:22.902 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:37:27.903 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:27.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:27.903 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:37:28.086 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:37:28.087 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:37:33.088 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:33.088 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:33.088 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:37:33.272 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:37:33.272 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:37:38.273 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:38.274 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:38.274 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:37:38.449 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:37:38.450 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:37:43.451 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:43.451 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:43.451 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:37:43.634 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:37:43.634 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:37:48.635 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:48.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:48.635 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:37:48.818 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:37:48.819 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:37:53.820 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:53.820 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:53.820 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:37:54.003 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:37:54.003 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:37:59.004 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:59.005 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:37:59.005 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:37:59.189 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:37:59.189 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:38:04.190 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:04.190 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:04.191 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:38:04.370 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:38:04.370 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:38:09.371 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:09.371 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:09.371 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:38:09.545 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:38:09.545 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:38:14.546 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:14.547 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:14.547 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:38:14.732 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:38:14.733 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:38:19.734 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:19.734 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:19.734 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:38:19.911 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:38:19.912 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:38:24.912 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:24.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:24.913 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:38:25.092 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:38:25.093 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:38:30.093 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:30.094 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:30.094 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:38:30.271 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:38:30.271 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:38:35.272 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:35.272 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:35.273 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:38:35.457 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:38:35.458 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:38:40.458 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:40.458 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:40.459 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:38:40.641 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:38:40.642 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:38:45.642 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:45.642 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:45.643 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:38:45.825 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:38:45.825 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:38:50.826 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:50.826 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:50.826 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:38:51.005 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:38:51.006 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:38:56.007 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:56.007 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:38:56.007 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:38:56.186 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:38:56.187 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:39:01.188 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:01.188 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:01.188 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:39:01.374 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:39:01.375 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:39:06.376 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:06.376 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:06.376 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:39:06.554 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:39:06.555 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:39:11.556 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:11.556 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:11.557 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:39:11.735 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:39:11.735 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:39:16.736 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:16.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:16.737 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:39:16.915 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:39:16.916 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:39:21.917 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:21.917 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:21.918 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:39:22.097 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:39:22.098 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:39:27.099 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:27.099 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:27.099 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:39:27.279 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:39:27.279 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:39:32.280 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:32.281 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:32.281 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:39:32.466 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:39:32.467 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:39:37.467 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:37.468 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:37.468 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:39:37.644 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:39:37.644 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:39:42.645 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:42.645 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:42.646 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:39:42.830 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:39:42.831 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:39:47.832 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:47.832 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:47.833 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:39:48.016 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:39:48.016 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:39:53.017 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:53.017 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:53.017 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:39:53.194 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:39:53.249 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:39:58.250 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:58.250 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:39:58.250 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:39:58.434 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:39:58.435 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:40:03.436 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:03.436 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:03.436 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:40:03.620 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:40:03.621 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:40:08.622 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:08.623 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:08.623 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:40:08.815 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:40:08.816 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:40:13.816 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:13.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:13.817 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:40:14.001 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:40:14.001 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:40:19.001 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:19.002 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:19.002 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:40:19.185 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:40:19.186 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:40:24.188 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:24.188 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:24.188 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:40:24.370 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:40:24.371 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:40:29.372 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:29.372 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:29.372 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:40:29.550 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:40:29.550 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:40:34.551 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:34.552 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:34.552 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:40:34.732 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:40:34.733 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:40:39.734 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:39.734 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:39.734 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:40:39.915 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:40:39.915 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:40:44.915 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:44.916 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:44.916 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:40:45.100 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:40:45.101 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:40:50.101 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:50.102 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:50.102 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:40:50.279 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:40:50.279 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:40:55.280 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:55.280 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:40:55.280 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:40:55.456 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:40:55.457 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:41:00.458 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:00.458 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:00.459 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:00.641 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:41:00.642 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:41:05.643 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:05.643 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:05.644 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:05.827 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:41:05.828 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:41:10.828 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:10.829 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:10.829 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:11.013 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:41:11.013 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:41:16.014 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:16.014 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:16.014 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:16.196 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:41:16.196 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:41:21.197 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:21.198 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:21.198 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:21.381 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:41:21.381 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:41:26.382 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:26.383 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:26.383 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:26.559 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:41:26.559 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:41:31.560 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:31.560 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:31.561 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:31.733 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:41:31.734 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:41:36.735 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:36.735 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:36.736 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:36.913 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:41:36.914 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:41:41.915 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:41.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:41.915 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:42.093 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:41:42.093 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:41:47.094 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:47.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:47.206 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:47.391 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:41:47.391 WARNING:rgw_multi.tests:bucket fggivf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.18.5 target= 2021-02-13T17:41:52.394 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_delete_marker_full_sync ... FAIL 2021-02-13T17:41:52.394 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-24 2021-02-13T17:41:52.481 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-25 2021-02-13T17:41:52.583 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=fggivf-26 2021-02-13T17:41:52.903 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:52.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:52.903 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:53.012 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=efc2d01e-ebf2-4522-b313-ef15a0018fb0 2021-02-13T17:41:53.026 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"1_1613236014.104172_63.1","last_update":"2021-02-13 17:06:54.104172Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238112.886659_209.1","last_update":"2021-02-13 17:41:52.886659Z"},{"marker":"1_1613236165.569853_155.1","last_update":"2021-02-13 17:09:25.569853Z"}] 2021-02-13T17:41:53.026 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:41:53.026 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:53.027 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:53.027 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:53.111 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238112.886659_209.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:41:52.886659Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:41:53.112 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:41:53.112 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:41:53.112 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:53.112 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:53.112 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:53.237 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238112.886659_209.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:41:52.886659Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:41:53.238 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:41:53.238 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:41:53.239 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:53.239 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:53.239 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:53.455 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238112.886659_209.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:41:52.886659Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:41:53.456 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:41:53.753 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:53.753 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:53.754 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-24 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:53.868 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000005.14.6"}]} 2021-02-13T17:41:53.869 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-24 2021-02-13T17:41:53.869 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:53.869 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:53.870 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:53.993 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:41:53.994 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone2 behind zone test-zone1: shard=0 master=00000000005.14.6 target= 2021-02-13T17:41:58.995 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:58.995 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:58.996 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:59.091 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"0#00000000005.14.6"}}}] 2021-02-13T17:41:59.092 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-24 2021-02-13T17:41:59.092 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:59.092 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:59.092 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-24 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:59.172 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000005.14.6"}]} 2021-02-13T17:41:59.172 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-24 2021-02-13T17:41:59.172 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:59.173 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:59.173 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-24 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:59.251 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"0#00000000005.14.6"}}}] 2021-02-13T17:41:59.251 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-24 2021-02-13T17:41:59.251 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:59.252 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:59.252 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-24 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:59.332 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000005.14.6"}]} 2021-02-13T17:41:59.333 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-24 2021-02-13T17:41:59.333 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:59.333 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:59.333 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:59.515 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"00000000005.14.6"}}}] 2021-02-13T17:41:59.516 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-24 2021-02-13T17:41:59.516 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:59.516 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:59.516 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:59.605 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000001.12.12"}]} 2021-02-13T17:41:59.605 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-24 2021-02-13T17:41:59.605 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:59.605 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:59.605 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:59.698 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"0#00000000001.12.12"}}}] 2021-02-13T17:41:59.699 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-24 2021-02-13T17:41:59.699 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:59.699 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:59.699 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:59.782 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000001.12.12"}]} 2021-02-13T17:41:59.783 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-24 2021-02-13T17:41:59.783 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:59.783 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:59.783 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:41:59.908 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"0#00000000001.12.12"}}}] 2021-02-13T17:41:59.908 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-24 2021-02-13T17:41:59.908 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:59.909 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:41:59.909 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:42:00.032 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000001.12.12"}]} 2021-02-13T17:42:00.032 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-24 2021-02-13T17:42:00.032 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:00.032 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:00.032 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:42:00.202 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:42:00.203 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:42:05.203 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:05.204 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:05.204 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:42:05.381 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:42:05.381 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:42:10.382 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:10.382 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:10.382 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:42:10.559 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:42:10.560 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:42:15.560 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:15.560 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:15.561 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:42:15.743 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:42:15.743 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:42:20.744 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:20.745 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:20.745 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:42:20.921 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:42:20.922 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:42:25.923 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:25.923 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:25.923 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:42:26.099 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:42:26.100 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:42:31.101 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:31.101 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:31.101 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:42:31.278 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:42:31.278 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:42:36.279 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:36.279 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:36.279 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:42:36.455 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:42:36.455 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:42:41.456 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:41.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:41.457 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:42:41.633 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:42:41.633 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:42:46.634 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:46.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:46.635 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:42:46.821 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:42:46.821 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:42:51.822 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:51.822 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:51.823 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:42:51.998 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:42:51.998 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:42:56.999 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:57.000 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:42:57.000 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:42:57.176 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:42:57.176 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:43:02.177 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:02.178 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:02.178 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:43:02.355 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:43:02.356 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:43:07.356 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:07.357 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:07.357 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:43:07.545 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:43:07.545 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:43:12.546 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:12.546 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:12.546 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:43:12.730 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:43:12.731 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:43:17.731 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:17.732 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:17.732 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:43:17.911 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:43:17.911 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:43:22.912 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:22.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:22.913 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:43:23.099 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:43:23.099 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:43:28.100 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:28.100 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:28.101 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:43:28.281 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:43:28.281 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:43:33.282 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:33.282 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:33.283 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:43:33.469 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:43:33.469 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:43:38.470 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:38.471 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:38.471 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:43:38.654 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:43:38.655 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:43:43.655 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:43.655 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:43.656 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:43:43.833 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:43:43.833 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:43:48.834 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:48.834 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:48.835 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:43:49.018 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:43:49.018 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:43:54.020 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:54.020 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:54.021 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:43:54.207 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:43:54.208 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:43:59.209 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:59.209 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:43:59.210 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:43:59.395 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:43:59.396 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:44:04.397 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:04.397 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:04.397 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:44:04.574 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:44:04.574 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:44:09.575 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:09.575 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:09.576 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:44:09.758 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:44:09.759 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:44:14.760 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:14.761 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:14.761 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:44:14.945 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:44:14.945 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:44:19.946 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:19.946 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:19.947 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:44:20.131 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:44:20.131 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:44:25.133 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:25.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:25.134 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:44:25.320 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:44:25.320 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:44:30.322 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:30.322 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:30.322 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:44:30.499 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:44:30.500 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:44:35.500 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:35.501 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:35.501 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:44:35.685 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:44:35.685 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:44:40.686 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:40.686 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:40.687 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:44:40.865 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:44:40.866 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:44:45.867 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:45.867 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:45.868 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:44:46.052 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:44:46.053 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:44:51.054 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:51.054 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:51.054 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:44:51.235 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:44:51.235 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:44:56.236 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:56.236 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:44:56.237 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:44:56.413 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:44:56.413 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:45:01.414 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:01.415 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:01.415 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:45:01.596 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:45:01.596 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:45:06.597 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:06.598 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:06.598 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:45:06.782 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:45:06.782 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:45:11.784 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:11.784 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:11.784 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:45:11.969 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:45:11.969 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:45:16.970 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:16.970 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:16.971 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:45:17.148 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:45:17.149 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:45:22.149 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:22.150 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:22.150 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:45:22.327 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:45:22.327 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:45:27.328 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:27.329 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:27.329 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:45:27.507 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:45:27.508 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:45:32.508 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:32.508 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:32.509 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:45:32.689 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:45:32.690 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:45:37.691 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:37.692 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:37.692 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:45:37.878 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:45:37.878 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:45:42.879 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:42.880 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:42.880 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:45:43.056 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:45:43.056 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:45:48.057 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:48.057 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:48.057 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:45:48.239 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:45:48.239 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:45:53.240 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:53.240 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:53.240 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:45:53.425 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:45:53.426 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:45:58.426 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:58.427 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:45:58.427 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:45:58.612 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:45:58.612 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:46:03.613 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:03.613 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:03.614 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:46:03.797 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:46:03.798 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:46:08.799 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:08.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:08.800 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:46:08.983 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:46:08.983 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:46:13.984 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:13.985 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:13.985 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:46:14.170 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:46:14.171 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:46:19.172 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:19.172 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:19.172 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:46:19.352 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:46:19.352 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:46:24.354 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:24.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:24.355 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:46:24.538 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:46:24.538 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:46:29.539 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:29.539 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:29.540 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:46:29.719 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:46:29.719 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:46:34.720 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:34.720 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:34.720 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:46:34.905 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:46:34.905 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:46:39.906 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:39.906 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:39.907 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:46:40.091 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:46:40.091 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:46:45.092 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:45.092 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:45.093 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:46:45.269 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:46:45.269 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:46:50.270 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:50.270 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:50.271 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:46:50.481 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:46:50.482 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:46:55.483 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:55.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:46:55.483 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:46:55.677 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:46:55.677 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:47:00.678 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:00.678 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:00.678 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:47:00.863 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:47:00.864 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:47:05.865 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:05.865 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:05.865 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:47:06.082 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:47:06.083 WARNING:rgw_multi.tests:bucket fggivf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.12.12 target= 2021-02-13T17:47:11.095 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_suspended_delete_marker_full_sync ... FAIL 2021-02-13T17:47:11.096 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-27 2021-02-13T17:47:11.158 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-28 2021-02-13T17:47:11.256 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=fggivf-29 2021-02-13T17:47:11.591 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_versioning ... ok 2021-02-13T17:47:11.591 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-30 2021-02-13T17:47:11.652 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-31 2021-02-13T17:47:11.751 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=fggivf-32 2021-02-13T17:47:12.091 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_acl ... ok 2021-02-13T17:47:12.091 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-33 2021-02-13T17:47:12.150 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-34 2021-02-13T17:47:12.230 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=fggivf-35 2021-02-13T17:47:14.483 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_cors ... ok 2021-02-13T17:47:14.483 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-36 2021-02-13T17:47:14.545 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-37 2021-02-13T17:47:14.629 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=fggivf-38 2021-02-13T17:47:14.731 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:14.731 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:14.731 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:47:14.835 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=efc2d01e-ebf2-4522-b313-ef15a0018fb0 2021-02-13T17:47:14.849 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"1_1613236014.104172_63.1","last_update":"2021-02-13 17:06:54.104172Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238434.687444_298.1","last_update":"2021-02-13 17:47:14.687444Z"},{"marker":"1_1613236165.569853_155.1","last_update":"2021-02-13 17:09:25.569853Z"}] 2021-02-13T17:47:14.849 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:47:14.849 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:14.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:14.850 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:47:14.930 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238434.531725_289.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:47:14.531725Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:47:14.930 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613238434.687444_298.1 target=1_1613238434.531725_289.1 2021-02-13T17:47:19.931 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:19.931 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:19.931 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:47:20.019 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238434.687444_298.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:47:14.687444Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:47:20.020 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:47:20.020 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:47:20.020 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:20.020 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:20.020 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:47:20.095 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238434.687444_298.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:47:14.687444Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:47:20.095 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:47:20.095 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:47:20.095 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:20.095 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:20.096 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:47:20.310 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238434.687444_298.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:47:14.687444Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:47:20.310 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:47:20.646 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_delete_notempty ... ok 2021-02-13T17:47:20.647 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-39 2021-02-13T17:47:20.709 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-40 2021-02-13T17:47:20.809 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=fggivf-41 2021-02-13T17:47:20.909 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:20.909 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:20.910 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:47:21.008 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=efc2d01e-ebf2-4522-b313-ef15a0018fb0 2021-02-13T17:47:21.022 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"1_1613236014.104172_63.1","last_update":"2021-02-13 17:06:54.104172Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238440.864145_311.1","last_update":"2021-02-13 17:47:20.864145Z"},{"marker":"1_1613236165.569853_155.1","last_update":"2021-02-13 17:09:25.569853Z"}] 2021-02-13T17:47:21.023 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:47:21.023 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:21.023 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:21.023 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:47:21.110 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238434.687444_298.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:47:14.687444Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:47:21.111 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613238440.864145_311.1 target=1_1613238434.687444_298.1 2021-02-13T17:47:26.112 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:26.112 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:26.112 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:47:26.192 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238440.864145_311.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:47:20.864145Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:47:26.193 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:47:26.193 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:47:26.193 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:26.193 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:26.193 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:47:26.278 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238440.864145_311.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:47:20.864145Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:47:26.278 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:47:26.278 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:47:26.278 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:26.278 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:47:26.279 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:47:26.494 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238440.864145_311.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:47:20.864145Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:47:26.494 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:47:26.494 DEBUG:tasks.rgw.c1.client.1:waiting for process to exit 2021-02-13T17:47:26.495 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T17:47:26.496 INFO:tasks.rgw.c1.client.1.gibba037.stdout:2021-02-13 17:47:26.492 7f8abf3e1700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 18319) UID: 0 2021-02-13T17:47:26.496 INFO:tasks.rgw.c1.client.1.gibba037.stdout:2021-02-13 17:47:26.492 7f8ad5d28980 -1 shutting down 2021-02-13T17:47:32.597 INFO:tasks.rgw.c1.client.1:Stopped 2021-02-13T17:47:32.597 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:47:32.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:47:32.597 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --master --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:47:32.865 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:47:32.861 7ffad0652940 0 NOTICE: overriding master zone: 828f8250-b337-4094-a551-9a6ba396e2f7 2021-02-13T17:47:32.865 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:47:32.861 7ffad0652940 0 failed reading obj info from .rgw.root:zone_info.0309fa59-88d6-4791-9422-c40c249763c5: (2) No such file or directory 2021-02-13T17:47:32.866 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:47:32.861 7ffad0652940 0 WARNING: could not read zone params for zone id=0309fa59-88d6-4791-9422-c40c249763c5 name=test-zone3 2021-02-13T17:47:32.866 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:47:32.861 7ffad0652940 0 failed reading obj info from .rgw.root:zone_info.828f8250-b337-4094-a551-9a6ba396e2f7: (2) No such file or directory 2021-02-13T17:47:32.867 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:47:32.861 7ffad0652940 0 WARNING: could not read zone params for zone id=828f8250-b337-4094-a551-9a6ba396e2f7 name=test-zone1 2021-02-13T17:47:32.871 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"MPD5WFU8HKLMFZF5","secret_key":"OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"} 2021-02-13T17:47:32.872 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:47:32.872 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:47:32.873 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:47:32.985 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b","epoch":1,"predecessor_uuid":"efc2d01e-ebf2-4522-b313-ef15a0018fb0","sync_status":["1_1613236014.104172_63.1","","1_1613238440.864145_311.1","1_1613236165.569853_155.1"],"period_map":{"id":"3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"683fc559-f564-4678-9d94-a4eeda89e756","zones":[{"id":"0309fa59-88d6-4791-9422-c40c249763c5","name":"test-zone3","endpoints":["http://gibba037.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"64418f57-773e-4390-b4e5-412c8c3de8c5","name":"test-zone4","endpoints":["http://gibba038.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","endpoints":["http://gibba038.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"828f8250-b337-4094-a551-9a6ba396e2f7","name":"test-zone1","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"}],"short_zone_ids":[{"key":"0309fa59-88d6-4791-9422-c40c249763c5","val":2792335811},{"key":"64418f57-773e-4390-b4e5-412c8c3de8c5","val":3971286608},{"key":"683fc559-f564-4678-9d94-a4eeda89e756","val":4148686205},{"key":"828f8250-b337-4094-a551-9a6ba396e2f7","val":2513897494}]},"master_zonegroup":"test-zonegroup","master_zone":"683fc559-f564-4678-9d94-a4eeda89e756","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f","realm_name":"test-realm","realm_epoch":3} 2021-02-13T17:47:32.986 INFO:rgw_multi.tests:Set master zone=test-zone2, waiting 60s for reconfiguration.. 2021-02-13T17:48:32.987 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-42 2021-02-13T17:48:33.096 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-43 2021-02-13T17:48:33.165 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:48:33.165 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:48:33.165 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:48:33.272 INFO:teuthology.orchestra.run.gibba038.stderr:No --period given, using current period=3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b 2021-02-13T17:48:33.287 INFO:teuthology.orchestra.run.gibba038.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238513.152695_136.1","last_update":"2021-02-13 17:48:33.152695Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T17:48:33.287 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone1 2021-02-13T17:48:33.288 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:48:33.288 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:48:33.288 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:48:33.368 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b","realm_epoch":3},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":27,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":52,"pos":0,"timestamp":"0.000000","realm_epoch":3}}]},"full_sync":{"total":80,"complete":80}} 2021-02-13T17:48:33.368 WARNING:rgw_multi.tests:zone test-zone1 behind master: shard=2 master=1_1613238513.152695_136.1 target= 2021-02-13T17:48:38.369 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:48:38.369 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:48:38.370 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:48:38.454 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b","realm_epoch":3},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":2,"val":{"state":1,"marker":"1_1613238513.152695_136.1","next_step_marker":"","total_entries":27,"pos":0,"timestamp":"2021-02-13 17:48:33.152695Z","realm_epoch":3}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":52,"pos":0,"timestamp":"0.000000","realm_epoch":3}}]},"full_sync":{"total":80,"complete":80}} 2021-02-13T17:48:38.454 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone1 2021-02-13T17:48:38.454 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:48:38.455 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'modify', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:48:38.455 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone modify --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --master --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:48:38.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:48:38.485 7fb92f2cf940 0 NOTICE: overriding master zone: 683fc559-f564-4678-9d94-a4eeda89e756 2021-02-13T17:48:38.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:48:38.485 7fb92f2cf940 0 failed reading obj info from .rgw.root:zone_info.64418f57-773e-4390-b4e5-412c8c3de8c5: (2) No such file or directory 2021-02-13T17:48:38.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:48:38.485 7fb92f2cf940 0 WARNING: could not read zone params for zone id=64418f57-773e-4390-b4e5-412c8c3de8c5 name=test-zone4 2021-02-13T17:48:38.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:48:38.485 7fb92f2cf940 0 failed reading obj info from .rgw.root:zone_info.683fc559-f564-4678-9d94-a4eeda89e756: (2) No such file or directory 2021-02-13T17:48:38.491 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 17:48:38.485 7fb92f2cf940 0 WARNING: could not read zone params for zone id=683fc559-f564-4678-9d94-a4eeda89e756 name=test-zone2 2021-02-13T17:48:38.498 INFO:teuthology.orchestra.run.gibba037.stdout:{"id":"828f8250-b337-4094-a551-9a6ba396e2f7","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","system_key":{"access_key":"MPD5WFU8HKLMFZF5","secret_key":"OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"} 2021-02-13T17:48:38.498 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:48:38.498 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:48:38.498 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:48:38.640 INFO:teuthology.orchestra.run.gibba037.stdout:{"id":"595e1dd1-4688-4d03-af39-72f8737fa57e","epoch":1,"predecessor_uuid":"3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b","sync_status":["","","1_1613238513.152695_136.1",""],"period_map":{"id":"595e1dd1-4688-4d03-af39-72f8737fa57e","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","zones":[{"id":"0309fa59-88d6-4791-9422-c40c249763c5","name":"test-zone3","endpoints":["http://gibba037.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"64418f57-773e-4390-b4e5-412c8c3de8c5","name":"test-zone4","endpoints":["http://gibba038.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","endpoints":["http://gibba038.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"828f8250-b337-4094-a551-9a6ba396e2f7","name":"test-zone1","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"}],"short_zone_ids":[{"key":"0309fa59-88d6-4791-9422-c40c249763c5","val":2792335811},{"key":"64418f57-773e-4390-b4e5-412c8c3de8c5","val":3971286608},{"key":"683fc559-f564-4678-9d94-a4eeda89e756","val":4148686205},{"key":"828f8250-b337-4094-a551-9a6ba396e2f7","val":2513897494}]},"master_zonegroup":"test-zonegroup","master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f","realm_name":"test-realm","realm_epoch":4} 2021-02-13T17:48:38.641 INFO:rgw_multi.tests:Set master zone=test-zone1, waiting 60s for reconfiguration.. 2021-02-13T17:49:38.641 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-44 2021-02-13T17:49:38.720 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-45 2021-02-13T17:49:38.833 INFO:tasks.rgw.c1.client.1:Restarting daemon 2021-02-13T17:49:38.833 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c1.client.1.stdout 2>&1 2021-02-13T17:49:38.837 INFO:tasks.rgw.c1.client.1:Started 2021-02-13T17:49:38.837 DEBUG:teuthology.orchestra.run.gibba037:> curl http://gibba037.front.sepia.ceph.com:8001 2021-02-13T17:49:38.864 INFO:teuthology.orchestra.run.gibba037.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:49:38.864 INFO:teuthology.orchestra.run.gibba037.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:49:38.868 INFO:teuthology.orchestra.run.gibba037.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to gibba037.front.sepia.ceph.com port 8001: Connection refused 2021-02-13T17:49:38.869 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-02-13T17:49:39.870 DEBUG:teuthology.orchestra.run.gibba037:> curl http://gibba037.front.sepia.ceph.com:8001 2021-02-13T17:49:39.893 INFO:teuthology.orchestra.run.gibba037.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:49:39.894 INFO:teuthology.orchestra.run.gibba037.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:49:39.901 INFO:teuthology.orchestra.run.gibba037.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 26750 0 --:--:-- --:--:-- --:--:-- 26750 2021-02-13T17:49:39.903 INFO:teuthology.orchestra.run.gibba037.stdout:anonymous 2021-02-13T17:49:39.903 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:39.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:39.904 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:40.050 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T17:49:40.066 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238578.788578_69.1","last_update":"2021-02-13 17:49:38.788578Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T17:49:40.067 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:49:40.067 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:40.067 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:40.067 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:40.152 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238578.788578_69.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:49:38.788578Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:49:40.152 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:49:40.152 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:49:40.152 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:40.153 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:40.153 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:40.273 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238578.788578_69.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:49:38.788578Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:49:40.274 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:49:40.274 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:49:40.274 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:40.274 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:40.275 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:40.491 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238578.788578_69.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:49:38.788578Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:49:40.492 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:49:40.492 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-39 zones={test-zone2, test-zone1} 2021-02-13T17:49:40.515 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:40.559 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:40.614 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-39 zones={test-zone2, test-zone1} 2021-02-13T17:49:40.614 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-39 zones={test-zone3, test-zone1} 2021-02-13T17:49:40.640 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:40.691 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:40.751 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-39 zones={test-zone3, test-zone1} 2021-02-13T17:49:40.751 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-39 zones={test-zone1, test-zone2} 2021-02-13T17:49:40.759 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:40.806 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:40.863 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-39 zones={test-zone1, test-zone2} 2021-02-13T17:49:40.863 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-39 zones={test-zone3, test-zone2} 2021-02-13T17:49:40.870 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:40.915 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:40.970 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-39 zones={test-zone3, test-zone2} 2021-02-13T17:49:40.970 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-39 zones={test-zone1, test-zone3} 2021-02-13T17:49:40.978 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:41.023 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:41.083 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-39 zones={test-zone1, test-zone3} 2021-02-13T17:49:41.084 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-39 zones={test-zone2, test-zone3} 2021-02-13T17:49:41.092 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:41.138 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:41.199 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-39 zones={test-zone2, test-zone3} 2021-02-13T17:49:41.199 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-40 zones={test-zone2, test-zone1} 2021-02-13T17:49:41.229 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:41.278 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:41.335 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-40 zones={test-zone2, test-zone1} 2021-02-13T17:49:41.335 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-40 zones={test-zone3, test-zone1} 2021-02-13T17:49:41.353 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:41.403 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:41.462 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-40 zones={test-zone3, test-zone1} 2021-02-13T17:49:41.462 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-40 zones={test-zone1, test-zone2} 2021-02-13T17:49:41.469 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:41.519 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:41.574 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-40 zones={test-zone1, test-zone2} 2021-02-13T17:49:41.575 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-40 zones={test-zone3, test-zone2} 2021-02-13T17:49:41.582 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:41.631 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:41.687 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-40 zones={test-zone3, test-zone2} 2021-02-13T17:49:41.687 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-40 zones={test-zone1, test-zone3} 2021-02-13T17:49:41.695 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:41.743 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:41.802 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-40 zones={test-zone1, test-zone3} 2021-02-13T17:49:41.803 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-40 zones={test-zone2, test-zone3} 2021-02-13T17:49:41.810 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:41.855 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:41.911 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-40 zones={test-zone2, test-zone3} 2021-02-13T17:49:41.911 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-41 zones={test-zone2, test-zone1} 2021-02-13T17:49:41.938 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:41.987 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:42.043 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-41 zones={test-zone2, test-zone1} 2021-02-13T17:49:42.043 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-41 zones={test-zone3, test-zone1} 2021-02-13T17:49:42.062 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:42.115 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:42.171 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-41 zones={test-zone3, test-zone1} 2021-02-13T17:49:42.172 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-41 zones={test-zone1, test-zone2} 2021-02-13T17:49:42.180 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:42.227 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:42.287 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-41 zones={test-zone1, test-zone2} 2021-02-13T17:49:42.287 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-41 zones={test-zone3, test-zone2} 2021-02-13T17:49:42.294 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:42.338 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:42.395 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-41 zones={test-zone3, test-zone2} 2021-02-13T17:49:42.395 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-41 zones={test-zone1, test-zone3} 2021-02-13T17:49:42.402 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:42.451 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:42.507 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-41 zones={test-zone1, test-zone3} 2021-02-13T17:49:42.507 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-41 zones={test-zone2, test-zone3} 2021-02-13T17:49:42.514 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:42.567 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:42.627 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-41 zones={test-zone2, test-zone3} 2021-02-13T17:49:42.627 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-42 zones={test-zone2, test-zone1} 2021-02-13T17:49:42.634 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:42.679 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:42.735 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-42 zones={test-zone2, test-zone1} 2021-02-13T17:49:42.735 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-42 zones={test-zone3, test-zone1} 2021-02-13T17:49:42.743 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:42.794 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:42.851 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-42 zones={test-zone3, test-zone1} 2021-02-13T17:49:42.851 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-42 zones={test-zone1, test-zone2} 2021-02-13T17:49:42.858 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:42.911 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:42.967 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-42 zones={test-zone1, test-zone2} 2021-02-13T17:49:42.967 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-42 zones={test-zone3, test-zone2} 2021-02-13T17:49:42.974 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:43.018 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:43.075 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-42 zones={test-zone3, test-zone2} 2021-02-13T17:49:43.075 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-42 zones={test-zone1, test-zone3} 2021-02-13T17:49:43.084 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:43.131 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:43.187 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-42 zones={test-zone1, test-zone3} 2021-02-13T17:49:43.187 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-42 zones={test-zone2, test-zone3} 2021-02-13T17:49:43.195 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:43.243 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:43.299 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-42 zones={test-zone2, test-zone3} 2021-02-13T17:49:43.299 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-43 zones={test-zone2, test-zone1} 2021-02-13T17:49:43.306 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:43.355 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:43.412 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-43 zones={test-zone2, test-zone1} 2021-02-13T17:49:43.412 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-43 zones={test-zone3, test-zone1} 2021-02-13T17:49:43.420 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:43.471 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:43.527 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-43 zones={test-zone3, test-zone1} 2021-02-13T17:49:43.527 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-43 zones={test-zone1, test-zone2} 2021-02-13T17:49:43.535 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:43.583 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:43.639 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-43 zones={test-zone1, test-zone2} 2021-02-13T17:49:43.639 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-43 zones={test-zone3, test-zone2} 2021-02-13T17:49:43.646 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:43.695 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:43.751 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-43 zones={test-zone3, test-zone2} 2021-02-13T17:49:43.751 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-43 zones={test-zone1, test-zone3} 2021-02-13T17:49:43.760 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:43.807 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:43.863 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-43 zones={test-zone1, test-zone3} 2021-02-13T17:49:43.863 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-43 zones={test-zone2, test-zone3} 2021-02-13T17:49:43.870 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:43.919 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:43.975 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-43 zones={test-zone2, test-zone3} 2021-02-13T17:49:43.976 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-44 zones={test-zone2, test-zone1} 2021-02-13T17:49:43.984 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:44.031 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:44.087 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-44 zones={test-zone2, test-zone1} 2021-02-13T17:49:44.087 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-44 zones={test-zone3, test-zone1} 2021-02-13T17:49:44.095 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:44.147 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:44.203 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-44 zones={test-zone3, test-zone1} 2021-02-13T17:49:44.203 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-44 zones={test-zone1, test-zone2} 2021-02-13T17:49:44.210 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:44.259 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:44.315 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-44 zones={test-zone1, test-zone2} 2021-02-13T17:49:44.315 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-44 zones={test-zone3, test-zone2} 2021-02-13T17:49:44.323 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:44.371 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:44.427 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-44 zones={test-zone3, test-zone2} 2021-02-13T17:49:44.427 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-44 zones={test-zone1, test-zone3} 2021-02-13T17:49:44.436 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:44.483 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:44.539 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-44 zones={test-zone1, test-zone3} 2021-02-13T17:49:44.539 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-44 zones={test-zone2, test-zone3} 2021-02-13T17:49:44.546 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:44.595 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:44.651 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-44 zones={test-zone2, test-zone3} 2021-02-13T17:49:44.651 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-45 zones={test-zone2, test-zone1} 2021-02-13T17:49:44.658 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:44.710 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:44.771 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-45 zones={test-zone2, test-zone1} 2021-02-13T17:49:44.771 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-45 zones={test-zone3, test-zone1} 2021-02-13T17:49:44.779 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:44.830 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:44.887 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-45 zones={test-zone3, test-zone1} 2021-02-13T17:49:44.887 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-45 zones={test-zone1, test-zone2} 2021-02-13T17:49:44.896 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:44.947 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:45.007 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-45 zones={test-zone1, test-zone2} 2021-02-13T17:49:45.008 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-45 zones={test-zone3, test-zone2} 2021-02-13T17:49:45.015 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:45.063 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:45.123 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-45 zones={test-zone3, test-zone2} 2021-02-13T17:49:45.123 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-45 zones={test-zone1, test-zone3} 2021-02-13T17:49:45.131 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:45.182 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:45.239 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-45 zones={test-zone1, test-zone3} 2021-02-13T17:49:45.239 INFO:tasks.rgw_multi.zone_rados:comparing bucket=fggivf-45 zones={test-zone2, test-zone3} 2021-02-13T17:49:45.247 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:49:45.295 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:49:45.355 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=fggivf-45 zones={test-zone2, test-zone3} 2021-02-13T17:49:45.355 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'efc2d01e-ebf2-4522-b313-ef15a0018fb0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:45.356 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'efc2d01e-ebf2-4522-b313-ef15a0018fb0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:45.356 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period efc2d01e-ebf2-4522-b313-ef15a0018fb0 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:45.486 INFO:teuthology.orchestra.run.gibba037.stdout:[{"id":"1_1613236014.099941_62.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-02-13 17:06:54.099941197Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-EqbQ-5-T-VOn7NS4I-3wpD","ver":1},"status":{"status":"write"}}},{"id":"1_1613236014.104172_63.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-02-13 17:06:54.104172306Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-EqbQ-5-T-VOn7NS4I-3wpD","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.196438_53.1","section":"bucket.instance","name":"fggivf-10:828f8250-b337-4094-a551-9a6ba396e2f7.4334.19","timestamp":"2021-02-13 17:09:31.196438735Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VqIo9kuwkG0XTnFoSK7eyK-","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.212307_54.1","section":"bucket.instance","name":"fggivf-10:828f8250-b337-4094-a551-9a6ba396e2f7.4334.19","timestamp":"2021-02-13 17:09:31.212307438Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VqIo9kuwkG0XTnFoSK7eyK-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.217988_55.1","section":"bucket","name":"fggivf-10","timestamp":"2021-02-13 17:09:31.217988294Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nxPcI_eGiafcaXWPcfqb5Vk","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.234221_56.1","section":"bucket","name":"fggivf-10","timestamp":"2021-02-13 17:09:31.234221933Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nxPcI_eGiafcaXWPcfqb5Vk","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.263723_57.1","section":"bucket.instance","name":"fggivf-11:828f8250-b337-4094-a551-9a6ba396e2f7.4334.20","timestamp":"2021-02-13 17:09:31.263723814Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bHDXjSYpcZqa8cF13iKmv-Z","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.280955_58.1","section":"bucket.instance","name":"fggivf-11:828f8250-b337-4094-a551-9a6ba396e2f7.4334.20","timestamp":"2021-02-13 17:09:31.280955898Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bHDXjSYpcZqa8cF13iKmv-Z","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.286667_59.1","section":"bucket","name":"fggivf-11","timestamp":"2021-02-13 17:09:31.286667194Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Et04VXAHGO2T4lGwRveYoQ1","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.302019_60.1","section":"bucket","name":"fggivf-11","timestamp":"2021-02-13 17:09:31.302019141Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Et04VXAHGO2T4lGwRveYoQ1","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.364279_61.1","section":"bucket.instance","name":"fggivf-12:828f8250-b337-4094-a551-9a6ba396e2f7.4334.21","timestamp":"2021-02-13 17:09:31.364279946Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oseyFAJlhQNqzgInpGtp0TD","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.380702_62.1","section":"bucket.instance","name":"fggivf-12:828f8250-b337-4094-a551-9a6ba396e2f7.4334.21","timestamp":"2021-02-13 17:09:31.380702382Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oseyFAJlhQNqzgInpGtp0TD","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.386265_63.1","section":"bucket","name":"fggivf-12","timestamp":"2021-02-13 17:09:31.386265156Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WbAeBcLswvqM1wd_YAUaTIh","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.401277_64.1","section":"bucket","name":"fggivf-12","timestamp":"2021-02-13 17:09:31.401277752Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WbAeBcLswvqM1wd_YAUaTIh","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.685309_71.1","section":"bucket.instance","name":"fggivf-13:828f8250-b337-4094-a551-9a6ba396e2f7.4334.22","timestamp":"2021-02-13 17:14:54.685309265Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bet3NdQXYKvr67yifwstqHa","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.701763_72.1","section":"bucket.instance","name":"fggivf-13:828f8250-b337-4094-a551-9a6ba396e2f7.4334.22","timestamp":"2021-02-13 17:14:54.701763932Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bet3NdQXYKvr67yifwstqHa","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.707087_73.1","section":"bucket","name":"fggivf-13","timestamp":"2021-02-13 17:14:54.707087471Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_B3O8SPnFCECzDcoGwLitIc4","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.722191_74.1","section":"bucket","name":"fggivf-13","timestamp":"2021-02-13 17:14:54.722191389Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_B3O8SPnFCECzDcoGwLitIc4","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.756933_75.1","section":"bucket.instance","name":"fggivf-14:828f8250-b337-4094-a551-9a6ba396e2f7.4334.23","timestamp":"2021-02-13 17:14:54.756933058Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bSUE5kl9CAXtByR8WRHpzt1","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.772874_76.1","section":"bucket.instance","name":"fggivf-14:828f8250-b337-4094-a551-9a6ba396e2f7.4334.23","timestamp":"2021-02-13 17:14:54.772874859Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bSUE5kl9CAXtByR8WRHpzt1","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.778694_77.1","section":"bucket","name":"fggivf-14","timestamp":"2021-02-13 17:14:54.778694733Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RklCZ_OXWLx7fnH2DF-eHxz","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.794815_78.1","section":"bucket","name":"fggivf-14","timestamp":"2021-02-13 17:14:54.794815276Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RklCZ_OXWLx7fnH2DF-eHxz","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.859459_79.1","section":"bucket.instance","name":"fggivf-15:828f8250-b337-4094-a551-9a6ba396e2f7.4334.24","timestamp":"2021-02-13 17:14:54.859459452Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Siw_0gtpVKdXR543NrVsJzq","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.875105_80.1","section":"bucket.instance","name":"fggivf-15:828f8250-b337-4094-a551-9a6ba396e2f7.4334.24","timestamp":"2021-02-13 17:14:54.875105442Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Siw_0gtpVKdXR543NrVsJzq","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.881339_81.1","section":"bucket","name":"fggivf-15","timestamp":"2021-02-13 17:14:54.881339509Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wfRCCKCutoHS32Z_LKOhZ-_","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.899000_82.1","section":"bucket","name":"fggivf-15","timestamp":"2021-02-13 17:14:54.899000450Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wfRCCKCutoHS32Z_LKOhZ-_","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.351934_98.1","section":"bucket.instance","name":"fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","timestamp":"2021-02-13 17:20:14.351934045Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.367986_99.1","section":"bucket.instance","name":"fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","timestamp":"2021-02-13 17:20:14.367986747Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.373839_100.1","section":"bucket","name":"fggivf-16","timestamp":"2021-02-13 17:20:14.373839766Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Wgs25dS8grYhXa5RLNPolFM","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.389049_101.1","section":"bucket","name":"fggivf-16","timestamp":"2021-02-13 17:20:14.389049062Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Wgs25dS8grYhXa5RLNPolFM","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.452556_102.1","section":"bucket.instance","name":"fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","timestamp":"2021-02-13 17:20:14.452556828Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.467356_103.1","section":"bucket.instance","name":"fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","timestamp":"2021-02-13 17:20:14.467356976Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.473165_104.1","section":"bucket","name":"fggivf-17","timestamp":"2021-02-13 17:20:14.473165220Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WK43gg7njPFFdyncspZKr6N","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.488426_105.1","section":"bucket","name":"fggivf-17","timestamp":"2021-02-13 17:20:14.488426065Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WK43gg7njPFFdyncspZKr6N","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.557187_106.1","section":"bucket.instance","name":"fggivf-18:828f8250-b337-4094-a551-9a6ba396e2f7.4334.27","timestamp":"2021-02-13 17:20:14.557187293Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.572460_107.1","section":"bucket.instance","name":"fggivf-18:828f8250-b337-4094-a551-9a6ba396e2f7.4334.27","timestamp":"2021-02-13 17:20:14.572460177Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.577949_108.1","section":"bucket","name":"fggivf-18","timestamp":"2021-02-13 17:20:14.577949325Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2LHX0c0R1XPMZ0M8-TFhz44","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.592532_109.1","section":"bucket","name":"fggivf-18","timestamp":"2021-02-13 17:20:14.592532320Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2LHX0c0R1XPMZ0M8-TFhz44","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.639959_110.1","section":"bucket.instance","name":"fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","timestamp":"2021-02-13 17:20:14.639959058Z","data":{"read_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":1},"write_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":2},"status":{"status":"write"}}},{"id":"1_1613236814.655562_111.1","section":"bucket.instance","name":"fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","timestamp":"2021-02-13 17:20:14.655562406Z","data":{"read_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":1},"write_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236814.665189_112.1","section":"bucket.instance","name":"fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","timestamp":"2021-02-13 17:20:14.665189301Z","data":{"read_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":1},"write_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":2},"status":{"status":"write"}}},{"id":"1_1613236814.681183_113.1","section":"bucket.instance","name":"fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","timestamp":"2021-02-13 17:20:14.681183928Z","data":{"read_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":1},"write_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236814.701746_114.1","section":"bucket.instance","name":"fggivf-18:828f8250-b337-4094-a551-9a6ba396e2f7.4334.27","timestamp":"2021-02-13 17:20:14.701746389Z","data":{"read_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":1},"write_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":2},"status":{"status":"write"}}},{"id":"1_1613236814.717897_115.1","section":"bucket.instance","name":"fggivf-18:828f8250-b337-4094-a551-9a6ba396e2f7.4334.27","timestamp":"2021-02-13 17:20:14.717897308Z","data":{"read_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":1},"write_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":2},"status":{"status":"complete"}}},{"id":"1_1613237142.622184_121.1","section":"bucket.instance","name":"fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","timestamp":"2021-02-13 17:25:42.622184525Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":1},"status":{"status":"write"}}},{"id":"1_1613237142.637550_122.1","section":"bucket.instance","name":"fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","timestamp":"2021-02-13 17:25:42.637550077Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237142.643141_123.1","section":"bucket","name":"fggivf-19","timestamp":"2021-02-13 17:25:42.643141946Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vNd2GKIsAUed0Y8dIy7JYVk","ver":1},"status":{"status":"write"}}},{"id":"1_1613237142.659069_124.1","section":"bucket","name":"fggivf-19","timestamp":"2021-02-13 17:25:42.659069522Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vNd2GKIsAUed0Y8dIy7JYVk","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237142.676967_125.1","section":"bucket.instance","name":"fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","timestamp":"2021-02-13 17:25:42.676967515Z","data":{"read_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":1},"write_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":2},"status":{"status":"write"}}},{"id":"1_1613237142.691994_126.1","section":"bucket.instance","name":"fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","timestamp":"2021-02-13 17:25:42.691994132Z","data":{"read_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":1},"write_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":2},"status":{"status":"complete"}}},{"id":"1_1613237465.669610_143.1","section":"bucket.instance","name":"fggivf-20:828f8250-b337-4094-a551-9a6ba396e2f7.4334.29","timestamp":"2021-02-13 17:31:05.669610151Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iAu6k8sFyJ8ucyuC09n-JOP","ver":1},"status":{"status":"write"}}},{"id":"1_1613237465.684813_144.1","section":"bucket.instance","name":"fggivf-20:828f8250-b337-4094-a551-9a6ba396e2f7.4334.29","timestamp":"2021-02-13 17:31:05.684813775Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iAu6k8sFyJ8ucyuC09n-JOP","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237465.690336_145.1","section":"bucket","name":"fggivf-20","timestamp":"2021-02-13 17:31:05.690336750Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kvL_VY8rpUJDn8f_Pwd8jyv","ver":1},"status":{"status":"write"}}},{"id":"1_1613237465.705456_146.1","section":"bucket","name":"fggivf-20","timestamp":"2021-02-13 17:31:05.705456444Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kvL_VY8rpUJDn8f_Pwd8jyv","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.761810_152.1","section":"bucket.instance","name":"fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","timestamp":"2021-02-13 17:36:28.761810479Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.776807_153.1","section":"bucket.instance","name":"fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","timestamp":"2021-02-13 17:36:28.776807744Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.782089_154.1","section":"bucket","name":"fggivf-21","timestamp":"2021-02-13 17:36:28.782089078Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SAq4BYH3EwV0UU61VP1pejU","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.796754_155.1","section":"bucket","name":"fggivf-21","timestamp":"2021-02-13 17:36:28.796754434Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SAq4BYH3EwV0UU61VP1pejU","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.838589_156.1","section":"bucket.instance","name":"fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","timestamp":"2021-02-13 17:36:28.838589398Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.853961_157.1","section":"bucket.instance","name":"fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","timestamp":"2021-02-13 17:36:28.853961735Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.859505_158.1","section":"bucket","name":"fggivf-22","timestamp":"2021-02-13 17:36:28.859505636Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eCxNTRRU6vroIYjjBDnY5XZ","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.874384_159.1","section":"bucket","name":"fggivf-22","timestamp":"2021-02-13 17:36:28.874384442Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eCxNTRRU6vroIYjjBDnY5XZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.945045_160.1","section":"bucket.instance","name":"fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","timestamp":"2021-02-13 17:36:28.945045451Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.960629_161.1","section":"bucket.instance","name":"fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","timestamp":"2021-02-13 17:36:28.960629424Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.966694_162.1","section":"bucket","name":"fggivf-23","timestamp":"2021-02-13 17:36:28.966694385Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DSTm1o5MsVn7oaPFz55_QQo","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.980647_163.1","section":"bucket","name":"fggivf-23","timestamp":"2021-02-13 17:36:28.980647568Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DSTm1o5MsVn7oaPFz55_QQo","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237789.025752_164.1","section":"bucket.instance","name":"fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","timestamp":"2021-02-13 17:36:29.025752790Z","data":{"read_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":1},"write_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":2},"status":{"status":"write"}}},{"id":"1_1613237789.040157_165.1","section":"bucket.instance","name":"fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","timestamp":"2021-02-13 17:36:29.040157273Z","data":{"read_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":1},"write_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":2},"status":{"status":"complete"}}},{"id":"1_1613237789.053244_166.1","section":"bucket.instance","name":"fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","timestamp":"2021-02-13 17:36:29.053244209Z","data":{"read_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":1},"write_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":2},"status":{"status":"write"}}},{"id":"1_1613237789.068914_167.1","section":"bucket.instance","name":"fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","timestamp":"2021-02-13 17:36:29.068914555Z","data":{"read_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":1},"write_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":2},"status":{"status":"complete"}}},{"id":"1_1613237789.092382_168.1","section":"bucket.instance","name":"fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","timestamp":"2021-02-13 17:36:29.092382493Z","data":{"read_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":1},"write_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":2},"status":{"status":"write"}}},{"id":"1_1613237789.107690_169.1","section":"bucket.instance","name":"fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","timestamp":"2021-02-13 17:36:29.107690528Z","data":{"read_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":1},"write_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238112.432178_186.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.432178658Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.447711_187.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.447711839Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.453484_188.1","section":"bucket","name":"fggivf-24","timestamp":"2021-02-13 17:41:52.453484095Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GQBIz3Bmn45tGg3QZpgBzLl","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.468700_189.1","section":"bucket","name":"fggivf-24","timestamp":"2021-02-13 17:41:52.468700608Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GQBIz3Bmn45tGg3QZpgBzLl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.502635_190.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.502635621Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.517751_191.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.517751746Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.523727_192.1","section":"bucket","name":"fggivf-25","timestamp":"2021-02-13 17:41:52.523727660Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9QZ2f9ENO66rg0kQaL0rCKO","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.538746_193.1","section":"bucket","name":"fggivf-25","timestamp":"2021-02-13 17:41:52.538746514Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9QZ2f9ENO66rg0kQaL0rCKO","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.603353_194.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.603353685Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.619142_195.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.619142346Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.625305_196.1","section":"bucket","name":"fggivf-26","timestamp":"2021-02-13 17:41:52.625305155Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fWUBwfHqYL3oqMcQx9P7R8A","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.640724_197.1","section":"bucket","name":"fggivf-26","timestamp":"2021-02-13 17:41:52.640724565Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fWUBwfHqYL3oqMcQx9P7R8A","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.693308_198.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.693308506Z","data":{"read_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":1},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":2},"status":{"status":"write"}}},{"id":"1_1613238112.708606_199.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.708606961Z","data":{"read_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":1},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238112.718551_200.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.718551598Z","data":{"read_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":2},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":3},"status":{"status":"write"}}},{"id":"1_1613238112.733710_201.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.733710194Z","data":{"read_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":2},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":3},"status":{"status":"complete"}}},{"id":"1_1613238112.747048_202.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.747048544Z","data":{"read_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":1},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":2},"status":{"status":"write"}}},{"id":"1_1613238112.762327_203.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.762327000Z","data":{"read_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":1},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238112.791260_204.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.791260146Z","data":{"read_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":2},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":3},"status":{"status":"write"}}},{"id":"1_1613238112.807174_205.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.807174414Z","data":{"read_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":2},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":3},"status":{"status":"complete"}}},{"id":"1_1613238112.831806_206.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.831806374Z","data":{"read_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":1},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":2},"status":{"status":"write"}}},{"id":"1_1613238112.847291_207.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.847291901Z","data":{"read_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":1},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238112.871196_208.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.871196235Z","data":{"read_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":2},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":3},"status":{"status":"write"}}},{"id":"1_1613238112.886659_209.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.886659003Z","data":{"read_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":2},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":3},"status":{"status":"complete"}}},{"id":"1_1613238431.110994_232.1","section":"bucket.instance","name":"fggivf-27:828f8250-b337-4094-a551-9a6ba396e2f7.4334.36","timestamp":"2021-02-13 17:47:11.110994447Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.126328_233.1","section":"bucket.instance","name":"fggivf-27:828f8250-b337-4094-a551-9a6ba396e2f7.4334.36","timestamp":"2021-02-13 17:47:11.126328287Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.131489_234.1","section":"bucket","name":"fggivf-27","timestamp":"2021-02-13 17:47:11.131489568Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6Cy8XaR4r9WYhv_ztFn-mpf","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.146258_235.1","section":"bucket","name":"fggivf-27","timestamp":"2021-02-13 17:47:11.146258185Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6Cy8XaR4r9WYhv_ztFn-mpf","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.177639_236.1","section":"bucket.instance","name":"fggivf-28:828f8250-b337-4094-a551-9a6ba396e2f7.4334.37","timestamp":"2021-02-13 17:47:11.177639803Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.192729_237.1","section":"bucket.instance","name":"fggivf-28:828f8250-b337-4094-a551-9a6ba396e2f7.4334.37","timestamp":"2021-02-13 17:47:11.192729594Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.198158_238.1","section":"bucket","name":"fggivf-28","timestamp":"2021-02-13 17:47:11.198158261Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PA91Z3oPFW8M03bxnilmzO5","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.213216_239.1","section":"bucket","name":"fggivf-28","timestamp":"2021-02-13 17:47:11.213216863Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PA91Z3oPFW8M03bxnilmzO5","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.275134_240.1","section":"bucket.instance","name":"fggivf-29:828f8250-b337-4094-a551-9a6ba396e2f7.4334.38","timestamp":"2021-02-13 17:47:11.275134983Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.291290_241.1","section":"bucket.instance","name":"fggivf-29:828f8250-b337-4094-a551-9a6ba396e2f7.4334.38","timestamp":"2021-02-13 17:47:11.291290727Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.297391_242.1","section":"bucket","name":"fggivf-29","timestamp":"2021-02-13 17:47:11.297391016Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hkei1McsRKCT8pKcR36qyoK","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.313623_243.1","section":"bucket","name":"fggivf-29","timestamp":"2021-02-13 17:47:11.313623171Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hkei1McsRKCT8pKcR36qyoK","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.357873_244.1","section":"bucket.instance","name":"fggivf-27:828f8250-b337-4094-a551-9a6ba396e2f7.4334.36","timestamp":"2021-02-13 17:47:11.357873884Z","data":{"read_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":1},"write_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":2},"status":{"status":"write"}}},{"id":"1_1613238431.373561_245.1","section":"bucket.instance","name":"fggivf-27:828f8250-b337-4094-a551-9a6ba396e2f7.4334.36","timestamp":"2021-02-13 17:47:11.373561834Z","data":{"read_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":1},"write_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238431.431448_246.1","section":"bucket.instance","name":"fggivf-28:828f8250-b337-4094-a551-9a6ba396e2f7.4334.37","timestamp":"2021-02-13 17:47:11.431448394Z","data":{"read_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":1},"write_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":2},"status":{"status":"write"}}},{"id":"1_1613238431.448264_247.1","section":"bucket.instance","name":"fggivf-28:828f8250-b337-4094-a551-9a6ba396e2f7.4334.37","timestamp":"2021-02-13 17:47:11.448264002Z","data":{"read_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":1},"write_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238431.514051_248.1","section":"bucket.instance","name":"fggivf-29:828f8250-b337-4094-a551-9a6ba396e2f7.4334.38","timestamp":"2021-02-13 17:47:11.514051259Z","data":{"read_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":1},"write_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":2},"status":{"status":"write"}}},{"id":"1_1613238431.529019_249.1","section":"bucket.instance","name":"fggivf-29:828f8250-b337-4094-a551-9a6ba396e2f7.4334.38","timestamp":"2021-02-13 17:47:11.529019779Z","data":{"read_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":1},"write_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238431.604115_250.1","section":"bucket.instance","name":"fggivf-30:828f8250-b337-4094-a551-9a6ba396e2f7.4334.39","timestamp":"2021-02-13 17:47:11.604115910Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.620570_251.1","section":"bucket.instance","name":"fggivf-30:828f8250-b337-4094-a551-9a6ba396e2f7.4334.39","timestamp":"2021-02-13 17:47:11.620570555Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.626060_252.1","section":"bucket","name":"fggivf-30","timestamp":"2021-02-13 17:47:11.626060648Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iZD09tXPcC9vaV2z68fQzCF","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.641220_253.1","section":"bucket","name":"fggivf-30","timestamp":"2021-02-13 17:47:11.641220907Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iZD09tXPcC9vaV2z68fQzCF","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.670263_254.1","section":"bucket.instance","name":"fggivf-31:828f8250-b337-4094-a551-9a6ba396e2f7.4334.40","timestamp":"2021-02-13 17:47:11.670263825Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.685325_255.1","section":"bucket.instance","name":"fggivf-31:828f8250-b337-4094-a551-9a6ba396e2f7.4334.40","timestamp":"2021-02-13 17:47:11.685325015Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.691225_256.1","section":"bucket","name":"fggivf-31","timestamp":"2021-02-13 17:47:11.691225792Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GPZ6dExScYRc4voXrZgR_-d","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.706046_257.1","section":"bucket","name":"fggivf-31","timestamp":"2021-02-13 17:47:11.706046764Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GPZ6dExScYRc4voXrZgR_-d","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.769586_258.1","section":"bucket.instance","name":"fggivf-32:828f8250-b337-4094-a551-9a6ba396e2f7.4334.41","timestamp":"2021-02-13 17:47:11.769586952Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.786167_259.1","section":"bucket.instance","name":"fggivf-32:828f8250-b337-4094-a551-9a6ba396e2f7.4334.41","timestamp":"2021-02-13 17:47:11.786167576Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.792407_260.1","section":"bucket","name":"fggivf-32","timestamp":"2021-02-13 17:47:11.792407276Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BMNwg0clYxO4nk3eV73Facz","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.807305_261.1","section":"bucket","name":"fggivf-32","timestamp":"2021-02-13 17:47:11.807305878Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BMNwg0clYxO4nk3eV73Facz","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.854693_262.1","section":"bucket.instance","name":"fggivf-30:828f8250-b337-4094-a551-9a6ba396e2f7.4334.39","timestamp":"2021-02-13 17:47:11.854693585Z","data":{"read_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":1},"write_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":2},"status":{"status":"write"}}},{"id":"1_1613238431.869998_263.1","section":"bucket.instance","name":"fggivf-30:828f8250-b337-4094-a551-9a6ba396e2f7.4334.39","timestamp":"2021-02-13 17:47:11.869998434Z","data":{"read_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":1},"write_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238431.924481_264.1","section":"bucket.instance","name":"fggivf-31:828f8250-b337-4094-a551-9a6ba396e2f7.4334.40","timestamp":"2021-02-13 17:47:11.924481477Z","data":{"read_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":1},"write_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":2},"status":{"status":"write"}}},{"id":"1_1613238431.939618_265.1","section":"bucket.instance","name":"fggivf-31:828f8250-b337-4094-a551-9a6ba396e2f7.4334.40","timestamp":"2021-02-13 17:47:11.939618544Z","data":{"read_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":1},"write_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238432.012666_266.1","section":"bucket.instance","name":"fggivf-32:828f8250-b337-4094-a551-9a6ba396e2f7.4334.41","timestamp":"2021-02-13 17:47:12.012666100Z","data":{"read_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":1},"write_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":2},"status":{"status":"write"}}},{"id":"1_1613238432.029467_267.1","section":"bucket.instance","name":"fggivf-32:828f8250-b337-4094-a551-9a6ba396e2f7.4334.41","timestamp":"2021-02-13 17:47:12.029467966Z","data":{"read_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":1},"write_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238432.104055_268.1","section":"bucket.instance","name":"fggivf-33:828f8250-b337-4094-a551-9a6ba396e2f7.4334.42","timestamp":"2021-02-13 17:47:12.104055309Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.119795_269.1","section":"bucket.instance","name":"fggivf-33:828f8250-b337-4094-a551-9a6ba396e2f7.4334.42","timestamp":"2021-02-13 17:47:12.119795519Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.125075_270.1","section":"bucket","name":"fggivf-33","timestamp":"2021-02-13 17:47:12.125075320Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_gw_ofPwNHQ1fSnVedLiAcTj","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.139354_271.1","section":"bucket","name":"fggivf-33","timestamp":"2021-02-13 17:47:12.139354982Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_gw_ofPwNHQ1fSnVedLiAcTj","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.168601_272.1","section":"bucket.instance","name":"fggivf-34:828f8250-b337-4094-a551-9a6ba396e2f7.4334.43","timestamp":"2021-02-13 17:47:12.168601856Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.184386_273.1","section":"bucket.instance","name":"fggivf-34:828f8250-b337-4094-a551-9a6ba396e2f7.4334.43","timestamp":"2021-02-13 17:47:12.184386478Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.190106_274.1","section":"bucket","name":"fggivf-34","timestamp":"2021-02-13 17:47:12.190106317Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_aaLW-3YhFzLY9wSTlsDn6tM","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.205963_275.1","section":"bucket","name":"fggivf-34","timestamp":"2021-02-13 17:47:12.205963360Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_aaLW-3YhFzLY9wSTlsDn6tM","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.248026_276.1","section":"bucket.instance","name":"fggivf-35:828f8250-b337-4094-a551-9a6ba396e2f7.4334.44","timestamp":"2021-02-13 17:47:12.248026075Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.253923_277.1","section":"bucket.instance","name":"fggivf-35:828f8250-b337-4094-a551-9a6ba396e2f7.4334.44","timestamp":"2021-02-13 17:47:12.253923030Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.255524_278.1","section":"bucket","name":"fggivf-35","timestamp":"2021-02-13 17:47:12.255524489Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rojmW78rwGJU-nwoki0xa0F","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.259703_279.1","section":"bucket","name":"fggivf-35","timestamp":"2021-02-13 17:47:12.259703553Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rojmW78rwGJU-nwoki0xa0F","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.271275_280.1","section":"bucket.instance","name":"fggivf-33:828f8250-b337-4094-a551-9a6ba396e2f7.4334.42","timestamp":"2021-02-13 17:47:12.271275645Z","data":{"read_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":1},"write_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":2},"status":{"status":"write"}}},{"id":"1_1613238432.274462_281.1","section":"bucket.instance","name":"fggivf-33:828f8250-b337-4094-a551-9a6ba396e2f7.4334.42","timestamp":"2021-02-13 17:47:12.274462102Z","data":{"read_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":1},"write_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238433.322337_282.1","section":"bucket.instance","name":"fggivf-34:828f8250-b337-4094-a551-9a6ba396e2f7.4334.43","timestamp":"2021-02-13 17:47:13.322337702Z","data":{"read_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":1},"write_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":2},"status":{"status":"write"}}},{"id":"1_1613238433.338648_283.1","section":"bucket.instance","name":"fggivf-34:828f8250-b337-4094-a551-9a6ba396e2f7.4334.43","timestamp":"2021-02-13 17:47:13.338648163Z","data":{"read_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":1},"write_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238434.403111_284.1","section":"bucket.instance","name":"fggivf-35:828f8250-b337-4094-a551-9a6ba396e2f7.4334.44","timestamp":"2021-02-13 17:47:14.403111689Z","data":{"read_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":1},"write_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":2},"status":{"status":"write"}}},{"id":"1_1613238434.419714_285.1","section":"bucket.instance","name":"fggivf-35:828f8250-b337-4094-a551-9a6ba396e2f7.4334.44","timestamp":"2021-02-13 17:47:14.419714729Z","data":{"read_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":1},"write_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238434.495955_286.1","section":"bucket.instance","name":"fggivf-36:828f8250-b337-4094-a551-9a6ba396e2f7.4334.45","timestamp":"2021-02-13 17:47:14.495955275Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oFRvoHby-NEbuPiJg1Te1nF","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.511160_287.1","section":"bucket.instance","name":"fggivf-36:828f8250-b337-4094-a551-9a6ba396e2f7.4334.45","timestamp":"2021-02-13 17:47:14.511160668Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oFRvoHby-NEbuPiJg1Te1nF","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238434.516676_288.1","section":"bucket","name":"fggivf-36","timestamp":"2021-02-13 17:47:14.516676016Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bsQF25cf8hm7Sy5HS8anb54","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.531725_289.1","section":"bucket","name":"fggivf-36","timestamp":"2021-02-13 17:47:14.531725888Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bsQF25cf8hm7Sy5HS8anb54","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238434.567713_290.1","section":"bucket.instance","name":"fggivf-37:828f8250-b337-4094-a551-9a6ba396e2f7.4334.46","timestamp":"2021-02-13 17:47:14.567713005Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2koJCBhqViBn12TfgX4YTUi","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.583305_291.1","section":"bucket.instance","name":"fggivf-37:828f8250-b337-4094-a551-9a6ba396e2f7.4334.46","timestamp":"2021-02-13 17:47:14.583305306Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2koJCBhqViBn12TfgX4YTUi","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238434.589447_292.1","section":"bucket","name":"fggivf-37","timestamp":"2021-02-13 17:47:14.589447349Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xW11GxEwkt4pAdn-VhA3qWS","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.604868_293.1","section":"bucket","name":"fggivf-37","timestamp":"2021-02-13 17:47:14.604868280Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xW11GxEwkt4pAdn-VhA3qWS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238434.650663_295.1","section":"bucket.instance","name":"fggivf-38:828f8250-b337-4094-a551-9a6ba396e2f7.4334.47","timestamp":"2021-02-13 17:47:14.650663028Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PyQEbBLGkQ7_rBTmEDUkRDC","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.666398_296.1","section":"bucket.instance","name":"fggivf-38:828f8250-b337-4094-a551-9a6ba396e2f7.4334.47","timestamp":"2021-02-13 17:47:14.666398024Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PyQEbBLGkQ7_rBTmEDUkRDC","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238434.672194_297.1","section":"bucket","name":"fggivf-38","timestamp":"2021-02-13 17:47:14.672194433Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_tjB7sDK6SUz9uQt09EnxrA-","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.687444_298.1","section":"bucket","name":"fggivf-38","timestamp":"2021-02-13 17:47:14.687444045Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_tjB7sDK6SUz9uQt09EnxrA-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.659651_300.1","section":"bucket.instance","name":"fggivf-39:828f8250-b337-4094-a551-9a6ba396e2f7.4334.48","timestamp":"2021-02-13 17:47:20.659651295Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRK0CQi4K46Bh4QGj_5s4_n","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.675138_301.1","section":"bucket.instance","name":"fggivf-39:828f8250-b337-4094-a551-9a6ba396e2f7.4334.48","timestamp":"2021-02-13 17:47:20.675138034Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRK0CQi4K46Bh4QGj_5s4_n","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.681181_302.1","section":"bucket","name":"fggivf-39","timestamp":"2021-02-13 17:47:20.681181347Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cESFBjz-87rQcSednZLukn-","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.696424_303.1","section":"bucket","name":"fggivf-39","timestamp":"2021-02-13 17:47:20.696424972Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cESFBjz-87rQcSednZLukn-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.727667_304.1","section":"bucket.instance","name":"fggivf-40:828f8250-b337-4094-a551-9a6ba396e2f7.4334.49","timestamp":"2021-02-13 17:47:20.727667170Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2qczbG02DjkZx6nFdSZxPcL","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.742714_305.1","section":"bucket.instance","name":"fggivf-40:828f8250-b337-4094-a551-9a6ba396e2f7.4334.49","timestamp":"2021-02-13 17:47:20.742714068Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2qczbG02DjkZx6nFdSZxPcL","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.748897_306.1","section":"bucket","name":"fggivf-40","timestamp":"2021-02-13 17:47:20.748897447Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TmOyP1ZOYT9s4C5LGSsa8vl","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.764655_307.1","section":"bucket","name":"fggivf-40","timestamp":"2021-02-13 17:47:20.764655264Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TmOyP1ZOYT9s4C5LGSsa8vl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.827123_308.1","section":"bucket.instance","name":"fggivf-41:828f8250-b337-4094-a551-9a6ba396e2f7.4334.50","timestamp":"2021-02-13 17:47:20.827123309Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9XnLu93FXeHDofkHecbNN4b","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.842604_309.1","section":"bucket.instance","name":"fggivf-41:828f8250-b337-4094-a551-9a6ba396e2f7.4334.50","timestamp":"2021-02-13 17:47:20.842604793Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9XnLu93FXeHDofkHecbNN4b","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.848608_310.1","section":"bucket","name":"fggivf-41","timestamp":"2021-02-13 17:47:20.848608585Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZHh9J55KBd7MkjO5SBk-vLh","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.864145_311.1","section":"bucket","name":"fggivf-41","timestamp":"2021-02-13 17:47:20.864145723Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZHh9J55KBd7MkjO5SBk-vLh","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236133.197550_60.1","section":"bucket.instance","name":"fggivf-1:828f8250-b337-4094-a551-9a6ba396e2f7.4334.1","timestamp":"2021-02-13 17:08:53.197550882Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iwYERTwinHDhKEpW-rqBzp8","ver":1},"status":{"status":"write"}}},{"id":"1_1613236133.200947_61.1","section":"bucket.instance","name":"fggivf-1:828f8250-b337-4094-a551-9a6ba396e2f7.4334.1","timestamp":"2021-02-13 17:08:53.200947177Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iwYERTwinHDhKEpW-rqBzp8","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236133.202478_62.1","section":"bucket","name":"fggivf-1","timestamp":"2021-02-13 17:08:53.202478220Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LPYv-FdecuYmtn9SSLy-JHZ","ver":1},"status":{"status":"write"}}},{"id":"1_1613236133.206582_63.1","section":"bucket","name":"fggivf-1","timestamp":"2021-02-13 17:08:53.206582584Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LPYv-FdecuYmtn9SSLy-JHZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236133.246153_64.1","section":"bucket.instance","name":"fggivf-2:828f8250-b337-4094-a551-9a6ba396e2f7.4334.2","timestamp":"2021-02-13 17:08:53.246153618Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_I8iLHBQpakCuCLPHXO9q2vN","ver":1},"status":{"status":"write"}}},{"id":"1_1613236133.251139_65.1","section":"bucket.instance","name":"fggivf-2:828f8250-b337-4094-a551-9a6ba396e2f7.4334.2","timestamp":"2021-02-13 17:08:53.251139941Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_I8iLHBQpakCuCLPHXO9q2vN","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236133.253212_66.1","section":"bucket","name":"fggivf-2","timestamp":"2021-02-13 17:08:53.253212610Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E92Hr2Fs_1EA1S3K3EDmI_H","ver":1},"status":{"status":"write"}}},{"id":"1_1613236133.258917_67.1","section":"bucket","name":"fggivf-2","timestamp":"2021-02-13 17:08:53.258917343Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E92Hr2Fs_1EA1S3K3EDmI_H","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236134.406749_68.1","section":"bucket.instance","name":"fggivf-3:828f8250-b337-4094-a551-9a6ba396e2f7.4334.3","timestamp":"2021-02-13 17:08:54.406749728Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9M7LinCV5mR9088T0TcClvf","ver":1},"status":{"status":"write"}}},{"id":"1_1613236134.422269_69.1","section":"bucket.instance","name":"fggivf-3:828f8250-b337-4094-a551-9a6ba396e2f7.4334.3","timestamp":"2021-02-13 17:08:54.422269785Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9M7LinCV5mR9088T0TcClvf","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236134.428721_70.1","section":"bucket","name":"fggivf-3","timestamp":"2021-02-13 17:08:54.428721503Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wk6Qojt3L3LYLYkkItAup_o","ver":1},"status":{"status":"write"}}},{"id":"1_1613236134.444689_71.1","section":"bucket","name":"fggivf-3","timestamp":"2021-02-13 17:08:54.444689615Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wk6Qojt3L3LYLYkkItAup_o","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.770049_72.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.4","timestamp":"2021-02-13 17:08:56.770049312Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WdJWtm6Et68NovSs4Mz-Njd","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.785646_73.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.4","timestamp":"2021-02-13 17:08:56.785646586Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WdJWtm6Et68NovSs4Mz-Njd","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.791980_74.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:08:56.791980224Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zDXyt_VCl0mDYK8kQXK1gB2","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.807148_75.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:08:56.807148902Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zDXyt_VCl0mDYK8kQXK1gB2","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.835479_76.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.5","timestamp":"2021-02-13 17:08:56.835479041Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZeRq4idumAd0kJI7fzA2l-t","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.851468_77.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.5","timestamp":"2021-02-13 17:08:56.851468248Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZeRq4idumAd0kJI7fzA2l-t","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.857413_78.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:08:56.857413919Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E50TYDuCr354gdVlNjyS6_c","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.872838_79.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:08:56.872838900Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E50TYDuCr354gdVlNjyS6_c","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.934850_80.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.6","timestamp":"2021-02-13 17:08:56.934850258Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ie2Iy01UbzbWz5vfABk9fUl","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.951266_81.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.6","timestamp":"2021-02-13 17:08:56.951266414Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ie2Iy01UbzbWz5vfABk9fUl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.957106_82.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:08:56.957106108Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FjsXvYcvMg190djv14ASo-P","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.973626_83.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:08:56.973626594Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FjsXvYcvMg190djv14ASo-P","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.631677_84.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.7","timestamp":"2021-02-13 17:09:02.631677351Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.647548_85.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.7","timestamp":"2021-02-13 17:09:02.647548032Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.653493_86.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:02.653493574Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lrvu-9J8P0Qz9rirKPuLeSg","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.664789_87.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:02.664789113Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lrvu-9J8P0Qz9rirKPuLeSg","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236142.674711_88.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.7","timestamp":"2021-02-13 17:09:02.674711599Z","data":{"read_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":1},"write_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236142.689989_89.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.7","timestamp":"2021-02-13 17:09:02.689989837Z","data":{"read_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":1},"write_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236142.716861_90.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.8","timestamp":"2021-02-13 17:09:02.716861437Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.733587_91.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.8","timestamp":"2021-02-13 17:09:02.733587245Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.739866_92.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:02.739866856Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fEtN4yrcqZzdlH7Obu_wLl8","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.750685_93.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:02.750685926Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fEtN4yrcqZzdlH7Obu_wLl8","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236142.761155_94.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.8","timestamp":"2021-02-13 17:09:02.761155199Z","data":{"read_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":1},"write_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236142.775386_95.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.8","timestamp":"2021-02-13 17:09:02.775386218Z","data":{"read_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":1},"write_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236142.794617_96.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.9","timestamp":"2021-02-13 17:09:02.794617617Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.805719_97.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.9","timestamp":"2021-02-13 17:09:02.805719376Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.810241_98.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:02.810241733Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BbyFGtWq3GDAk_CBCFBVpbK","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.818865_99.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:02.818865566Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BbyFGtWq3GDAk_CBCFBVpbK","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236142.827228_100.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.9","timestamp":"2021-02-13 17:09:02.827228530Z","data":{"read_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":1},"write_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236142.838159_101.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.9","timestamp":"2021-02-13 17:09:02.838159819Z","data":{"read_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":1},"write_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236142.862019_102.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.10","timestamp":"2021-02-13 17:09:02.862019577Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.872078_103.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.10","timestamp":"2021-02-13 17:09:02.872078859Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.875943_104.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:02.875943276Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5Qw8xrxcL9PbNpxRqGzgs-x","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.883891_105.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:02.883891746Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5Qw8xrxcL9PbNpxRqGzgs-x","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236142.891075_106.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.10","timestamp":"2021-02-13 17:09:02.891075869Z","data":{"read_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":1},"write_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236142.901752_107.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.10","timestamp":"2021-02-13 17:09:02.901752455Z","data":{"read_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":1},"write_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236142.959830_108.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.11","timestamp":"2021-02-13 17:09:02.959830129Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.975302_109.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.11","timestamp":"2021-02-13 17:09:02.975302404Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.980644_110.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:02.980644518Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZBgeeoKpk_cVxf28vkNxXEh","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.991050_111.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:02.991050845Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZBgeeoKpk_cVxf28vkNxXEh","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236143.000310_112.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.11","timestamp":"2021-02-13 17:09:03.000310684Z","data":{"read_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":1},"write_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236143.015207_113.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.11","timestamp":"2021-02-13 17:09:03.015207766Z","data":{"read_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":1},"write_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236143.077484_114.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.12","timestamp":"2021-02-13 17:09:03.077484714Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.093641_115.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.12","timestamp":"2021-02-13 17:09:03.093641018Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236143.099932_116.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:03.099932950Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7n3rrkZ1z6GUeQYwqdZWlQc","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.111225_117.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:03.111225751Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7n3rrkZ1z6GUeQYwqdZWlQc","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236143.121091_118.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.12","timestamp":"2021-02-13 17:09:03.121091705Z","data":{"read_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":1},"write_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236143.136215_119.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.12","timestamp":"2021-02-13 17:09:03.136215200Z","data":{"read_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":1},"write_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236143.240544_120.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.13","timestamp":"2021-02-13 17:09:03.240544868Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.256062_121.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.13","timestamp":"2021-02-13 17:09:03.256062169Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236143.261970_122.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:03.261970913Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_c4p9j46Ekxm24ng54KkYX5V","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.273238_123.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:03.273238024Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_c4p9j46Ekxm24ng54KkYX5V","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236143.283107_124.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.13","timestamp":"2021-02-13 17:09:03.283107093Z","data":{"read_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":1},"write_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236143.298002_125.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.13","timestamp":"2021-02-13 17:09:03.298002217Z","data":{"read_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":1},"write_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236143.359814_126.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.14","timestamp":"2021-02-13 17:09:03.359814410Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.375221_127.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.14","timestamp":"2021-02-13 17:09:03.375221646Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236143.381038_128.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:03.381038078Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XvI88UZ1iLAh3aib-aaO9UX","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.391506_129.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:03.391506444Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XvI88UZ1iLAh3aib-aaO9UX","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236143.401486_130.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.14","timestamp":"2021-02-13 17:09:03.401486198Z","data":{"read_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":1},"write_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236143.416837_131.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.14","timestamp":"2021-02-13 17:09:03.416837625Z","data":{"read_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":1},"write_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236143.517883_132.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.15","timestamp":"2021-02-13 17:09:03.517883464Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.533432_133.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.15","timestamp":"2021-02-13 17:09:03.533432357Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236143.539825_134.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:03.539825925Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-z0jqf_7EggFfDdVF7UgGvE","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.551491_135.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:03.551491057Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-z0jqf_7EggFfDdVF7UgGvE","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236143.561428_136.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.15","timestamp":"2021-02-13 17:09:03.561428385Z","data":{"read_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":1},"write_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236143.577282_137.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.15","timestamp":"2021-02-13 17:09:03.577282401Z","data":{"read_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":1},"write_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236159.521655_138.1","section":"bucket.instance","name":"fggivf-7:828f8250-b337-4094-a551-9a6ba396e2f7.4334.16","timestamp":"2021-02-13 17:09:19.521655971Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Novyg1ni_NVvq7E3Sxcuc9j","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.538369_139.1","section":"bucket.instance","name":"fggivf-7:828f8250-b337-4094-a551-9a6ba396e2f7.4334.16","timestamp":"2021-02-13 17:09:19.538369977Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Novyg1ni_NVvq7E3Sxcuc9j","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236159.545091_140.1","section":"bucket","name":"fggivf-7","timestamp":"2021-02-13 17:09:19.545091698Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.562813_141.1","section":"bucket","name":"fggivf-7","timestamp":"2021-02-13 17:09:19.562813463Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236159.592942_142.1","section":"bucket.instance","name":"fggivf-8:828f8250-b337-4094-a551-9a6ba396e2f7.4334.17","timestamp":"2021-02-13 17:09:19.592942571Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rS5HrgXvvd0g20Kc9nZDh57","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.609255_143.1","section":"bucket.instance","name":"fggivf-8:828f8250-b337-4094-a551-9a6ba396e2f7.4334.17","timestamp":"2021-02-13 17:09:19.609255746Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rS5HrgXvvd0g20Kc9nZDh57","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236159.614994_144.1","section":"bucket","name":"fggivf-8","timestamp":"2021-02-13 17:09:19.614994093Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.630344_145.1","section":"bucket","name":"fggivf-8","timestamp":"2021-02-13 17:09:19.630344839Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236159.692632_146.1","section":"bucket.instance","name":"fggivf-9:828f8250-b337-4094-a551-9a6ba396e2f7.4334.18","timestamp":"2021-02-13 17:09:19.692632205Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3Cb1enbvLKK1av5fFEjGanj","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.708401_147.1","section":"bucket.instance","name":"fggivf-9:828f8250-b337-4094-a551-9a6ba396e2f7.4334.18","timestamp":"2021-02-13 17:09:19.708401977Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3Cb1enbvLKK1av5fFEjGanj","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236159.714476_148.1","section":"bucket","name":"fggivf-9","timestamp":"2021-02-13 17:09:19.714476498Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.729777_149.1","section":"bucket","name":"fggivf-9","timestamp":"2021-02-13 17:09:19.729777247Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236165.416017_150.1","section":"bucket","name":"fggivf-7","timestamp":"2021-02-13 17:09:25.416017261Z","data":{"read_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":1},"write_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236165.431937_151.1","section":"bucket","name":"fggivf-7","timestamp":"2021-02-13 17:09:25.431937039Z","data":{"read_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":1},"write_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236165.469186_152.1","section":"bucket","name":"fggivf-8","timestamp":"2021-02-13 17:09:25.469186740Z","data":{"read_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":1},"write_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236165.484451_153.1","section":"bucket","name":"fggivf-8","timestamp":"2021-02-13 17:09:25.484451837Z","data":{"read_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":1},"write_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236165.555023_154.1","section":"bucket","name":"fggivf-9","timestamp":"2021-02-13 17:09:25.555023108Z","data":{"read_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":1},"write_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236165.569853_155.1","section":"bucket","name":"fggivf-9","timestamp":"2021-02-13 17:09:25.569853904Z","data":{"read_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":1},"write_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":2},"status":{"status":"complete"}}}] 2021-02-13T17:49:45.489 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'efc2d01e-ebf2-4522-b313-ef15a0018fb0', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:45.489 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'efc2d01e-ebf2-4522-b313-ef15a0018fb0', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:45.489 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period efc2d01e-ebf2-4522-b313-ef15a0018fb0 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:45.575 INFO:teuthology.orchestra.run.gibba038.stdout:[{"id":"1_1613236014.099941_62.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-02-13 17:06:54.099941197Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-EqbQ-5-T-VOn7NS4I-3wpD","ver":1},"status":{"status":"write"}}},{"id":"1_1613236014.104172_63.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-02-13 17:06:54.104172306Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-EqbQ-5-T-VOn7NS4I-3wpD","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.196438_53.1","section":"bucket.instance","name":"fggivf-10:828f8250-b337-4094-a551-9a6ba396e2f7.4334.19","timestamp":"2021-02-13 17:09:31.196438735Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VqIo9kuwkG0XTnFoSK7eyK-","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.212307_54.1","section":"bucket.instance","name":"fggivf-10:828f8250-b337-4094-a551-9a6ba396e2f7.4334.19","timestamp":"2021-02-13 17:09:31.212307438Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VqIo9kuwkG0XTnFoSK7eyK-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.217988_55.1","section":"bucket","name":"fggivf-10","timestamp":"2021-02-13 17:09:31.217988294Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nxPcI_eGiafcaXWPcfqb5Vk","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.234221_56.1","section":"bucket","name":"fggivf-10","timestamp":"2021-02-13 17:09:31.234221933Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nxPcI_eGiafcaXWPcfqb5Vk","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.263723_57.1","section":"bucket.instance","name":"fggivf-11:828f8250-b337-4094-a551-9a6ba396e2f7.4334.20","timestamp":"2021-02-13 17:09:31.263723814Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bHDXjSYpcZqa8cF13iKmv-Z","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.280955_58.1","section":"bucket.instance","name":"fggivf-11:828f8250-b337-4094-a551-9a6ba396e2f7.4334.20","timestamp":"2021-02-13 17:09:31.280955898Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bHDXjSYpcZqa8cF13iKmv-Z","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.286667_59.1","section":"bucket","name":"fggivf-11","timestamp":"2021-02-13 17:09:31.286667194Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Et04VXAHGO2T4lGwRveYoQ1","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.302019_60.1","section":"bucket","name":"fggivf-11","timestamp":"2021-02-13 17:09:31.302019141Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Et04VXAHGO2T4lGwRveYoQ1","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.364279_61.1","section":"bucket.instance","name":"fggivf-12:828f8250-b337-4094-a551-9a6ba396e2f7.4334.21","timestamp":"2021-02-13 17:09:31.364279946Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oseyFAJlhQNqzgInpGtp0TD","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.380702_62.1","section":"bucket.instance","name":"fggivf-12:828f8250-b337-4094-a551-9a6ba396e2f7.4334.21","timestamp":"2021-02-13 17:09:31.380702382Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oseyFAJlhQNqzgInpGtp0TD","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.386265_63.1","section":"bucket","name":"fggivf-12","timestamp":"2021-02-13 17:09:31.386265156Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WbAeBcLswvqM1wd_YAUaTIh","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.401277_64.1","section":"bucket","name":"fggivf-12","timestamp":"2021-02-13 17:09:31.401277752Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WbAeBcLswvqM1wd_YAUaTIh","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.685309_71.1","section":"bucket.instance","name":"fggivf-13:828f8250-b337-4094-a551-9a6ba396e2f7.4334.22","timestamp":"2021-02-13 17:14:54.685309265Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bet3NdQXYKvr67yifwstqHa","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.701763_72.1","section":"bucket.instance","name":"fggivf-13:828f8250-b337-4094-a551-9a6ba396e2f7.4334.22","timestamp":"2021-02-13 17:14:54.701763932Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bet3NdQXYKvr67yifwstqHa","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.707087_73.1","section":"bucket","name":"fggivf-13","timestamp":"2021-02-13 17:14:54.707087471Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_B3O8SPnFCECzDcoGwLitIc4","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.722191_74.1","section":"bucket","name":"fggivf-13","timestamp":"2021-02-13 17:14:54.722191389Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_B3O8SPnFCECzDcoGwLitIc4","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.756933_75.1","section":"bucket.instance","name":"fggivf-14:828f8250-b337-4094-a551-9a6ba396e2f7.4334.23","timestamp":"2021-02-13 17:14:54.756933058Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bSUE5kl9CAXtByR8WRHpzt1","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.772874_76.1","section":"bucket.instance","name":"fggivf-14:828f8250-b337-4094-a551-9a6ba396e2f7.4334.23","timestamp":"2021-02-13 17:14:54.772874859Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bSUE5kl9CAXtByR8WRHpzt1","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.778694_77.1","section":"bucket","name":"fggivf-14","timestamp":"2021-02-13 17:14:54.778694733Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RklCZ_OXWLx7fnH2DF-eHxz","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.794815_78.1","section":"bucket","name":"fggivf-14","timestamp":"2021-02-13 17:14:54.794815276Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RklCZ_OXWLx7fnH2DF-eHxz","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.859459_79.1","section":"bucket.instance","name":"fggivf-15:828f8250-b337-4094-a551-9a6ba396e2f7.4334.24","timestamp":"2021-02-13 17:14:54.859459452Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Siw_0gtpVKdXR543NrVsJzq","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.875105_80.1","section":"bucket.instance","name":"fggivf-15:828f8250-b337-4094-a551-9a6ba396e2f7.4334.24","timestamp":"2021-02-13 17:14:54.875105442Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Siw_0gtpVKdXR543NrVsJzq","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.881339_81.1","section":"bucket","name":"fggivf-15","timestamp":"2021-02-13 17:14:54.881339509Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wfRCCKCutoHS32Z_LKOhZ-_","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.899000_82.1","section":"bucket","name":"fggivf-15","timestamp":"2021-02-13 17:14:54.899000450Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wfRCCKCutoHS32Z_LKOhZ-_","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.351934_98.1","section":"bucket.instance","name":"fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","timestamp":"2021-02-13 17:20:14.351934045Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.367986_99.1","section":"bucket.instance","name":"fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","timestamp":"2021-02-13 17:20:14.367986747Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.373839_100.1","section":"bucket","name":"fggivf-16","timestamp":"2021-02-13 17:20:14.373839766Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Wgs25dS8grYhXa5RLNPolFM","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.389049_101.1","section":"bucket","name":"fggivf-16","timestamp":"2021-02-13 17:20:14.389049062Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Wgs25dS8grYhXa5RLNPolFM","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.452556_102.1","section":"bucket.instance","name":"fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","timestamp":"2021-02-13 17:20:14.452556828Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.467356_103.1","section":"bucket.instance","name":"fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","timestamp":"2021-02-13 17:20:14.467356976Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.473165_104.1","section":"bucket","name":"fggivf-17","timestamp":"2021-02-13 17:20:14.473165220Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WK43gg7njPFFdyncspZKr6N","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.488426_105.1","section":"bucket","name":"fggivf-17","timestamp":"2021-02-13 17:20:14.488426065Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WK43gg7njPFFdyncspZKr6N","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.557187_106.1","section":"bucket.instance","name":"fggivf-18:828f8250-b337-4094-a551-9a6ba396e2f7.4334.27","timestamp":"2021-02-13 17:20:14.557187293Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.572460_107.1","section":"bucket.instance","name":"fggivf-18:828f8250-b337-4094-a551-9a6ba396e2f7.4334.27","timestamp":"2021-02-13 17:20:14.572460177Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.577949_108.1","section":"bucket","name":"fggivf-18","timestamp":"2021-02-13 17:20:14.577949325Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2LHX0c0R1XPMZ0M8-TFhz44","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.592532_109.1","section":"bucket","name":"fggivf-18","timestamp":"2021-02-13 17:20:14.592532320Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2LHX0c0R1XPMZ0M8-TFhz44","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.639959_110.1","section":"bucket.instance","name":"fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","timestamp":"2021-02-13 17:20:14.639959058Z","data":{"read_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":1},"write_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":2},"status":{"status":"write"}}},{"id":"1_1613236814.655562_111.1","section":"bucket.instance","name":"fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","timestamp":"2021-02-13 17:20:14.655562406Z","data":{"read_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":1},"write_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236814.665189_112.1","section":"bucket.instance","name":"fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","timestamp":"2021-02-13 17:20:14.665189301Z","data":{"read_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":1},"write_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":2},"status":{"status":"write"}}},{"id":"1_1613236814.681183_113.1","section":"bucket.instance","name":"fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","timestamp":"2021-02-13 17:20:14.681183928Z","data":{"read_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":1},"write_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236814.701746_114.1","section":"bucket.instance","name":"fggivf-18:828f8250-b337-4094-a551-9a6ba396e2f7.4334.27","timestamp":"2021-02-13 17:20:14.701746389Z","data":{"read_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":1},"write_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":2},"status":{"status":"write"}}},{"id":"1_1613236814.717897_115.1","section":"bucket.instance","name":"fggivf-18:828f8250-b337-4094-a551-9a6ba396e2f7.4334.27","timestamp":"2021-02-13 17:20:14.717897308Z","data":{"read_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":1},"write_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":2},"status":{"status":"complete"}}},{"id":"1_1613237142.622184_121.1","section":"bucket.instance","name":"fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","timestamp":"2021-02-13 17:25:42.622184525Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":1},"status":{"status":"write"}}},{"id":"1_1613237142.637550_122.1","section":"bucket.instance","name":"fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","timestamp":"2021-02-13 17:25:42.637550077Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237142.643141_123.1","section":"bucket","name":"fggivf-19","timestamp":"2021-02-13 17:25:42.643141946Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vNd2GKIsAUed0Y8dIy7JYVk","ver":1},"status":{"status":"write"}}},{"id":"1_1613237142.659069_124.1","section":"bucket","name":"fggivf-19","timestamp":"2021-02-13 17:25:42.659069522Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vNd2GKIsAUed0Y8dIy7JYVk","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237142.676967_125.1","section":"bucket.instance","name":"fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","timestamp":"2021-02-13 17:25:42.676967515Z","data":{"read_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":1},"write_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":2},"status":{"status":"write"}}},{"id":"1_1613237142.691994_126.1","section":"bucket.instance","name":"fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","timestamp":"2021-02-13 17:25:42.691994132Z","data":{"read_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":1},"write_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":2},"status":{"status":"complete"}}},{"id":"1_1613237465.669610_143.1","section":"bucket.instance","name":"fggivf-20:828f8250-b337-4094-a551-9a6ba396e2f7.4334.29","timestamp":"2021-02-13 17:31:05.669610151Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iAu6k8sFyJ8ucyuC09n-JOP","ver":1},"status":{"status":"write"}}},{"id":"1_1613237465.684813_144.1","section":"bucket.instance","name":"fggivf-20:828f8250-b337-4094-a551-9a6ba396e2f7.4334.29","timestamp":"2021-02-13 17:31:05.684813775Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iAu6k8sFyJ8ucyuC09n-JOP","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237465.690336_145.1","section":"bucket","name":"fggivf-20","timestamp":"2021-02-13 17:31:05.690336750Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kvL_VY8rpUJDn8f_Pwd8jyv","ver":1},"status":{"status":"write"}}},{"id":"1_1613237465.705456_146.1","section":"bucket","name":"fggivf-20","timestamp":"2021-02-13 17:31:05.705456444Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kvL_VY8rpUJDn8f_Pwd8jyv","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.761810_152.1","section":"bucket.instance","name":"fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","timestamp":"2021-02-13 17:36:28.761810479Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.776807_153.1","section":"bucket.instance","name":"fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","timestamp":"2021-02-13 17:36:28.776807744Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.782089_154.1","section":"bucket","name":"fggivf-21","timestamp":"2021-02-13 17:36:28.782089078Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SAq4BYH3EwV0UU61VP1pejU","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.796754_155.1","section":"bucket","name":"fggivf-21","timestamp":"2021-02-13 17:36:28.796754434Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SAq4BYH3EwV0UU61VP1pejU","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.838589_156.1","section":"bucket.instance","name":"fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","timestamp":"2021-02-13 17:36:28.838589398Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.853961_157.1","section":"bucket.instance","name":"fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","timestamp":"2021-02-13 17:36:28.853961735Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.859505_158.1","section":"bucket","name":"fggivf-22","timestamp":"2021-02-13 17:36:28.859505636Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eCxNTRRU6vroIYjjBDnY5XZ","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.874384_159.1","section":"bucket","name":"fggivf-22","timestamp":"2021-02-13 17:36:28.874384442Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eCxNTRRU6vroIYjjBDnY5XZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.945045_160.1","section":"bucket.instance","name":"fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","timestamp":"2021-02-13 17:36:28.945045451Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.960629_161.1","section":"bucket.instance","name":"fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","timestamp":"2021-02-13 17:36:28.960629424Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.966694_162.1","section":"bucket","name":"fggivf-23","timestamp":"2021-02-13 17:36:28.966694385Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DSTm1o5MsVn7oaPFz55_QQo","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.980647_163.1","section":"bucket","name":"fggivf-23","timestamp":"2021-02-13 17:36:28.980647568Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DSTm1o5MsVn7oaPFz55_QQo","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237789.025752_164.1","section":"bucket.instance","name":"fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","timestamp":"2021-02-13 17:36:29.025752790Z","data":{"read_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":1},"write_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":2},"status":{"status":"write"}}},{"id":"1_1613237789.040157_165.1","section":"bucket.instance","name":"fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","timestamp":"2021-02-13 17:36:29.040157273Z","data":{"read_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":1},"write_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":2},"status":{"status":"complete"}}},{"id":"1_1613237789.053244_166.1","section":"bucket.instance","name":"fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","timestamp":"2021-02-13 17:36:29.053244209Z","data":{"read_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":1},"write_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":2},"status":{"status":"write"}}},{"id":"1_1613237789.068914_167.1","section":"bucket.instance","name":"fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","timestamp":"2021-02-13 17:36:29.068914555Z","data":{"read_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":1},"write_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":2},"status":{"status":"complete"}}},{"id":"1_1613237789.092382_168.1","section":"bucket.instance","name":"fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","timestamp":"2021-02-13 17:36:29.092382493Z","data":{"read_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":1},"write_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":2},"status":{"status":"write"}}},{"id":"1_1613237789.107690_169.1","section":"bucket.instance","name":"fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","timestamp":"2021-02-13 17:36:29.107690528Z","data":{"read_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":1},"write_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238112.432178_186.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.432178658Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.447711_187.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.447711839Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.453484_188.1","section":"bucket","name":"fggivf-24","timestamp":"2021-02-13 17:41:52.453484095Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GQBIz3Bmn45tGg3QZpgBzLl","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.468700_189.1","section":"bucket","name":"fggivf-24","timestamp":"2021-02-13 17:41:52.468700608Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GQBIz3Bmn45tGg3QZpgBzLl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.502635_190.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.502635621Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.517751_191.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.517751746Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.523727_192.1","section":"bucket","name":"fggivf-25","timestamp":"2021-02-13 17:41:52.523727660Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9QZ2f9ENO66rg0kQaL0rCKO","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.538746_193.1","section":"bucket","name":"fggivf-25","timestamp":"2021-02-13 17:41:52.538746514Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9QZ2f9ENO66rg0kQaL0rCKO","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.603353_194.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.603353685Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.619142_195.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.619142346Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.625305_196.1","section":"bucket","name":"fggivf-26","timestamp":"2021-02-13 17:41:52.625305155Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fWUBwfHqYL3oqMcQx9P7R8A","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.640724_197.1","section":"bucket","name":"fggivf-26","timestamp":"2021-02-13 17:41:52.640724565Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fWUBwfHqYL3oqMcQx9P7R8A","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.693308_198.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.693308506Z","data":{"read_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":1},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":2},"status":{"status":"write"}}},{"id":"1_1613238112.708606_199.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.708606961Z","data":{"read_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":1},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238112.718551_200.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.718551598Z","data":{"read_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":2},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":3},"status":{"status":"write"}}},{"id":"1_1613238112.733710_201.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.733710194Z","data":{"read_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":2},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":3},"status":{"status":"complete"}}},{"id":"1_1613238112.747048_202.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.747048544Z","data":{"read_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":1},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":2},"status":{"status":"write"}}},{"id":"1_1613238112.762327_203.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.762327000Z","data":{"read_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":1},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238112.791260_204.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.791260146Z","data":{"read_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":2},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":3},"status":{"status":"write"}}},{"id":"1_1613238112.807174_205.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.807174414Z","data":{"read_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":2},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":3},"status":{"status":"complete"}}},{"id":"1_1613238112.831806_206.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.831806374Z","data":{"read_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":1},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":2},"status":{"status":"write"}}},{"id":"1_1613238112.847291_207.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.847291901Z","data":{"read_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":1},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238112.871196_208.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.871196235Z","data":{"read_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":2},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":3},"status":{"status":"write"}}},{"id":"1_1613238112.886659_209.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.886659003Z","data":{"read_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":2},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":3},"status":{"status":"complete"}}},{"id":"1_1613238431.110994_232.1","section":"bucket.instance","name":"fggivf-27:828f8250-b337-4094-a551-9a6ba396e2f7.4334.36","timestamp":"2021-02-13 17:47:11.110994447Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.126328_233.1","section":"bucket.instance","name":"fggivf-27:828f8250-b337-4094-a551-9a6ba396e2f7.4334.36","timestamp":"2021-02-13 17:47:11.126328287Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.131489_234.1","section":"bucket","name":"fggivf-27","timestamp":"2021-02-13 17:47:11.131489568Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6Cy8XaR4r9WYhv_ztFn-mpf","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.146258_235.1","section":"bucket","name":"fggivf-27","timestamp":"2021-02-13 17:47:11.146258185Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6Cy8XaR4r9WYhv_ztFn-mpf","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.177639_236.1","section":"bucket.instance","name":"fggivf-28:828f8250-b337-4094-a551-9a6ba396e2f7.4334.37","timestamp":"2021-02-13 17:47:11.177639803Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.192729_237.1","section":"bucket.instance","name":"fggivf-28:828f8250-b337-4094-a551-9a6ba396e2f7.4334.37","timestamp":"2021-02-13 17:47:11.192729594Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.198158_238.1","section":"bucket","name":"fggivf-28","timestamp":"2021-02-13 17:47:11.198158261Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PA91Z3oPFW8M03bxnilmzO5","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.213216_239.1","section":"bucket","name":"fggivf-28","timestamp":"2021-02-13 17:47:11.213216863Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PA91Z3oPFW8M03bxnilmzO5","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.275134_240.1","section":"bucket.instance","name":"fggivf-29:828f8250-b337-4094-a551-9a6ba396e2f7.4334.38","timestamp":"2021-02-13 17:47:11.275134983Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.291290_241.1","section":"bucket.instance","name":"fggivf-29:828f8250-b337-4094-a551-9a6ba396e2f7.4334.38","timestamp":"2021-02-13 17:47:11.291290727Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.297391_242.1","section":"bucket","name":"fggivf-29","timestamp":"2021-02-13 17:47:11.297391016Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hkei1McsRKCT8pKcR36qyoK","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.313623_243.1","section":"bucket","name":"fggivf-29","timestamp":"2021-02-13 17:47:11.313623171Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hkei1McsRKCT8pKcR36qyoK","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.357873_244.1","section":"bucket.instance","name":"fggivf-27:828f8250-b337-4094-a551-9a6ba396e2f7.4334.36","timestamp":"2021-02-13 17:47:11.357873884Z","data":{"read_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":1},"write_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":2},"status":{"status":"write"}}},{"id":"1_1613238431.373561_245.1","section":"bucket.instance","name":"fggivf-27:828f8250-b337-4094-a551-9a6ba396e2f7.4334.36","timestamp":"2021-02-13 17:47:11.373561834Z","data":{"read_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":1},"write_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238431.431448_246.1","section":"bucket.instance","name":"fggivf-28:828f8250-b337-4094-a551-9a6ba396e2f7.4334.37","timestamp":"2021-02-13 17:47:11.431448394Z","data":{"read_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":1},"write_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":2},"status":{"status":"write"}}},{"id":"1_1613238431.448264_247.1","section":"bucket.instance","name":"fggivf-28:828f8250-b337-4094-a551-9a6ba396e2f7.4334.37","timestamp":"2021-02-13 17:47:11.448264002Z","data":{"read_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":1},"write_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238431.514051_248.1","section":"bucket.instance","name":"fggivf-29:828f8250-b337-4094-a551-9a6ba396e2f7.4334.38","timestamp":"2021-02-13 17:47:11.514051259Z","data":{"read_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":1},"write_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":2},"status":{"status":"write"}}},{"id":"1_1613238431.529019_249.1","section":"bucket.instance","name":"fggivf-29:828f8250-b337-4094-a551-9a6ba396e2f7.4334.38","timestamp":"2021-02-13 17:47:11.529019779Z","data":{"read_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":1},"write_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238431.604115_250.1","section":"bucket.instance","name":"fggivf-30:828f8250-b337-4094-a551-9a6ba396e2f7.4334.39","timestamp":"2021-02-13 17:47:11.604115910Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.620570_251.1","section":"bucket.instance","name":"fggivf-30:828f8250-b337-4094-a551-9a6ba396e2f7.4334.39","timestamp":"2021-02-13 17:47:11.620570555Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.626060_252.1","section":"bucket","name":"fggivf-30","timestamp":"2021-02-13 17:47:11.626060648Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iZD09tXPcC9vaV2z68fQzCF","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.641220_253.1","section":"bucket","name":"fggivf-30","timestamp":"2021-02-13 17:47:11.641220907Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iZD09tXPcC9vaV2z68fQzCF","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.670263_254.1","section":"bucket.instance","name":"fggivf-31:828f8250-b337-4094-a551-9a6ba396e2f7.4334.40","timestamp":"2021-02-13 17:47:11.670263825Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.685325_255.1","section":"bucket.instance","name":"fggivf-31:828f8250-b337-4094-a551-9a6ba396e2f7.4334.40","timestamp":"2021-02-13 17:47:11.685325015Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.691225_256.1","section":"bucket","name":"fggivf-31","timestamp":"2021-02-13 17:47:11.691225792Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GPZ6dExScYRc4voXrZgR_-d","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.706046_257.1","section":"bucket","name":"fggivf-31","timestamp":"2021-02-13 17:47:11.706046764Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GPZ6dExScYRc4voXrZgR_-d","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.769586_258.1","section":"bucket.instance","name":"fggivf-32:828f8250-b337-4094-a551-9a6ba396e2f7.4334.41","timestamp":"2021-02-13 17:47:11.769586952Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.786167_259.1","section":"bucket.instance","name":"fggivf-32:828f8250-b337-4094-a551-9a6ba396e2f7.4334.41","timestamp":"2021-02-13 17:47:11.786167576Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.792407_260.1","section":"bucket","name":"fggivf-32","timestamp":"2021-02-13 17:47:11.792407276Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BMNwg0clYxO4nk3eV73Facz","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.807305_261.1","section":"bucket","name":"fggivf-32","timestamp":"2021-02-13 17:47:11.807305878Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BMNwg0clYxO4nk3eV73Facz","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.854693_262.1","section":"bucket.instance","name":"fggivf-30:828f8250-b337-4094-a551-9a6ba396e2f7.4334.39","timestamp":"2021-02-13 17:47:11.854693585Z","data":{"read_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":1},"write_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":2},"status":{"status":"write"}}},{"id":"1_1613238431.869998_263.1","section":"bucket.instance","name":"fggivf-30:828f8250-b337-4094-a551-9a6ba396e2f7.4334.39","timestamp":"2021-02-13 17:47:11.869998434Z","data":{"read_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":1},"write_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238431.924481_264.1","section":"bucket.instance","name":"fggivf-31:828f8250-b337-4094-a551-9a6ba396e2f7.4334.40","timestamp":"2021-02-13 17:47:11.924481477Z","data":{"read_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":1},"write_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":2},"status":{"status":"write"}}},{"id":"1_1613238431.939618_265.1","section":"bucket.instance","name":"fggivf-31:828f8250-b337-4094-a551-9a6ba396e2f7.4334.40","timestamp":"2021-02-13 17:47:11.939618544Z","data":{"read_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":1},"write_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238432.012666_266.1","section":"bucket.instance","name":"fggivf-32:828f8250-b337-4094-a551-9a6ba396e2f7.4334.41","timestamp":"2021-02-13 17:47:12.012666100Z","data":{"read_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":1},"write_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":2},"status":{"status":"write"}}},{"id":"1_1613238432.029467_267.1","section":"bucket.instance","name":"fggivf-32:828f8250-b337-4094-a551-9a6ba396e2f7.4334.41","timestamp":"2021-02-13 17:47:12.029467966Z","data":{"read_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":1},"write_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238432.104055_268.1","section":"bucket.instance","name":"fggivf-33:828f8250-b337-4094-a551-9a6ba396e2f7.4334.42","timestamp":"2021-02-13 17:47:12.104055309Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.119795_269.1","section":"bucket.instance","name":"fggivf-33:828f8250-b337-4094-a551-9a6ba396e2f7.4334.42","timestamp":"2021-02-13 17:47:12.119795519Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.125075_270.1","section":"bucket","name":"fggivf-33","timestamp":"2021-02-13 17:47:12.125075320Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_gw_ofPwNHQ1fSnVedLiAcTj","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.139354_271.1","section":"bucket","name":"fggivf-33","timestamp":"2021-02-13 17:47:12.139354982Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_gw_ofPwNHQ1fSnVedLiAcTj","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.168601_272.1","section":"bucket.instance","name":"fggivf-34:828f8250-b337-4094-a551-9a6ba396e2f7.4334.43","timestamp":"2021-02-13 17:47:12.168601856Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.184386_273.1","section":"bucket.instance","name":"fggivf-34:828f8250-b337-4094-a551-9a6ba396e2f7.4334.43","timestamp":"2021-02-13 17:47:12.184386478Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.190106_274.1","section":"bucket","name":"fggivf-34","timestamp":"2021-02-13 17:47:12.190106317Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_aaLW-3YhFzLY9wSTlsDn6tM","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.205963_275.1","section":"bucket","name":"fggivf-34","timestamp":"2021-02-13 17:47:12.205963360Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_aaLW-3YhFzLY9wSTlsDn6tM","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.248026_276.1","section":"bucket.instance","name":"fggivf-35:828f8250-b337-4094-a551-9a6ba396e2f7.4334.44","timestamp":"2021-02-13 17:47:12.248026075Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.253923_277.1","section":"bucket.instance","name":"fggivf-35:828f8250-b337-4094-a551-9a6ba396e2f7.4334.44","timestamp":"2021-02-13 17:47:12.253923030Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.255524_278.1","section":"bucket","name":"fggivf-35","timestamp":"2021-02-13 17:47:12.255524489Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rojmW78rwGJU-nwoki0xa0F","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.259703_279.1","section":"bucket","name":"fggivf-35","timestamp":"2021-02-13 17:47:12.259703553Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rojmW78rwGJU-nwoki0xa0F","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.271275_280.1","section":"bucket.instance","name":"fggivf-33:828f8250-b337-4094-a551-9a6ba396e2f7.4334.42","timestamp":"2021-02-13 17:47:12.271275645Z","data":{"read_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":1},"write_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":2},"status":{"status":"write"}}},{"id":"1_1613238432.274462_281.1","section":"bucket.instance","name":"fggivf-33:828f8250-b337-4094-a551-9a6ba396e2f7.4334.42","timestamp":"2021-02-13 17:47:12.274462102Z","data":{"read_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":1},"write_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238433.322337_282.1","section":"bucket.instance","name":"fggivf-34:828f8250-b337-4094-a551-9a6ba396e2f7.4334.43","timestamp":"2021-02-13 17:47:13.322337702Z","data":{"read_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":1},"write_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":2},"status":{"status":"write"}}},{"id":"1_1613238433.338648_283.1","section":"bucket.instance","name":"fggivf-34:828f8250-b337-4094-a551-9a6ba396e2f7.4334.43","timestamp":"2021-02-13 17:47:13.338648163Z","data":{"read_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":1},"write_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238434.403111_284.1","section":"bucket.instance","name":"fggivf-35:828f8250-b337-4094-a551-9a6ba396e2f7.4334.44","timestamp":"2021-02-13 17:47:14.403111689Z","data":{"read_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":1},"write_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":2},"status":{"status":"write"}}},{"id":"1_1613238434.419714_285.1","section":"bucket.instance","name":"fggivf-35:828f8250-b337-4094-a551-9a6ba396e2f7.4334.44","timestamp":"2021-02-13 17:47:14.419714729Z","data":{"read_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":1},"write_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238434.495955_286.1","section":"bucket.instance","name":"fggivf-36:828f8250-b337-4094-a551-9a6ba396e2f7.4334.45","timestamp":"2021-02-13 17:47:14.495955275Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oFRvoHby-NEbuPiJg1Te1nF","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.511160_287.1","section":"bucket.instance","name":"fggivf-36:828f8250-b337-4094-a551-9a6ba396e2f7.4334.45","timestamp":"2021-02-13 17:47:14.511160668Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oFRvoHby-NEbuPiJg1Te1nF","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238434.516676_288.1","section":"bucket","name":"fggivf-36","timestamp":"2021-02-13 17:47:14.516676016Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bsQF25cf8hm7Sy5HS8anb54","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.531725_289.1","section":"bucket","name":"fggivf-36","timestamp":"2021-02-13 17:47:14.531725888Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bsQF25cf8hm7Sy5HS8anb54","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238434.567713_290.1","section":"bucket.instance","name":"fggivf-37:828f8250-b337-4094-a551-9a6ba396e2f7.4334.46","timestamp":"2021-02-13 17:47:14.567713005Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2koJCBhqViBn12TfgX4YTUi","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.583305_291.1","section":"bucket.instance","name":"fggivf-37:828f8250-b337-4094-a551-9a6ba396e2f7.4334.46","timestamp":"2021-02-13 17:47:14.583305306Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2koJCBhqViBn12TfgX4YTUi","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238434.589447_292.1","section":"bucket","name":"fggivf-37","timestamp":"2021-02-13 17:47:14.589447349Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xW11GxEwkt4pAdn-VhA3qWS","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.604868_293.1","section":"bucket","name":"fggivf-37","timestamp":"2021-02-13 17:47:14.604868280Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xW11GxEwkt4pAdn-VhA3qWS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238434.650663_295.1","section":"bucket.instance","name":"fggivf-38:828f8250-b337-4094-a551-9a6ba396e2f7.4334.47","timestamp":"2021-02-13 17:47:14.650663028Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PyQEbBLGkQ7_rBTmEDUkRDC","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.666398_296.1","section":"bucket.instance","name":"fggivf-38:828f8250-b337-4094-a551-9a6ba396e2f7.4334.47","timestamp":"2021-02-13 17:47:14.666398024Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PyQEbBLGkQ7_rBTmEDUkRDC","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238434.672194_297.1","section":"bucket","name":"fggivf-38","timestamp":"2021-02-13 17:47:14.672194433Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_tjB7sDK6SUz9uQt09EnxrA-","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.687444_298.1","section":"bucket","name":"fggivf-38","timestamp":"2021-02-13 17:47:14.687444045Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_tjB7sDK6SUz9uQt09EnxrA-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.659651_300.1","section":"bucket.instance","name":"fggivf-39:828f8250-b337-4094-a551-9a6ba396e2f7.4334.48","timestamp":"2021-02-13 17:47:20.659651295Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRK0CQi4K46Bh4QGj_5s4_n","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.675138_301.1","section":"bucket.instance","name":"fggivf-39:828f8250-b337-4094-a551-9a6ba396e2f7.4334.48","timestamp":"2021-02-13 17:47:20.675138034Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRK0CQi4K46Bh4QGj_5s4_n","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.681181_302.1","section":"bucket","name":"fggivf-39","timestamp":"2021-02-13 17:47:20.681181347Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cESFBjz-87rQcSednZLukn-","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.696424_303.1","section":"bucket","name":"fggivf-39","timestamp":"2021-02-13 17:47:20.696424972Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cESFBjz-87rQcSednZLukn-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.727667_304.1","section":"bucket.instance","name":"fggivf-40:828f8250-b337-4094-a551-9a6ba396e2f7.4334.49","timestamp":"2021-02-13 17:47:20.727667170Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2qczbG02DjkZx6nFdSZxPcL","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.742714_305.1","section":"bucket.instance","name":"fggivf-40:828f8250-b337-4094-a551-9a6ba396e2f7.4334.49","timestamp":"2021-02-13 17:47:20.742714068Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2qczbG02DjkZx6nFdSZxPcL","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.748897_306.1","section":"bucket","name":"fggivf-40","timestamp":"2021-02-13 17:47:20.748897447Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TmOyP1ZOYT9s4C5LGSsa8vl","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.764655_307.1","section":"bucket","name":"fggivf-40","timestamp":"2021-02-13 17:47:20.764655264Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TmOyP1ZOYT9s4C5LGSsa8vl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.827123_308.1","section":"bucket.instance","name":"fggivf-41:828f8250-b337-4094-a551-9a6ba396e2f7.4334.50","timestamp":"2021-02-13 17:47:20.827123309Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9XnLu93FXeHDofkHecbNN4b","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.842604_309.1","section":"bucket.instance","name":"fggivf-41:828f8250-b337-4094-a551-9a6ba396e2f7.4334.50","timestamp":"2021-02-13 17:47:20.842604793Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9XnLu93FXeHDofkHecbNN4b","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.848608_310.1","section":"bucket","name":"fggivf-41","timestamp":"2021-02-13 17:47:20.848608585Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZHh9J55KBd7MkjO5SBk-vLh","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.864145_311.1","section":"bucket","name":"fggivf-41","timestamp":"2021-02-13 17:47:20.864145723Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZHh9J55KBd7MkjO5SBk-vLh","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236133.197550_60.1","section":"bucket.instance","name":"fggivf-1:828f8250-b337-4094-a551-9a6ba396e2f7.4334.1","timestamp":"2021-02-13 17:08:53.197550882Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iwYERTwinHDhKEpW-rqBzp8","ver":1},"status":{"status":"write"}}},{"id":"1_1613236133.200947_61.1","section":"bucket.instance","name":"fggivf-1:828f8250-b337-4094-a551-9a6ba396e2f7.4334.1","timestamp":"2021-02-13 17:08:53.200947177Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iwYERTwinHDhKEpW-rqBzp8","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236133.202478_62.1","section":"bucket","name":"fggivf-1","timestamp":"2021-02-13 17:08:53.202478220Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LPYv-FdecuYmtn9SSLy-JHZ","ver":1},"status":{"status":"write"}}},{"id":"1_1613236133.206582_63.1","section":"bucket","name":"fggivf-1","timestamp":"2021-02-13 17:08:53.206582584Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LPYv-FdecuYmtn9SSLy-JHZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236133.246153_64.1","section":"bucket.instance","name":"fggivf-2:828f8250-b337-4094-a551-9a6ba396e2f7.4334.2","timestamp":"2021-02-13 17:08:53.246153618Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_I8iLHBQpakCuCLPHXO9q2vN","ver":1},"status":{"status":"write"}}},{"id":"1_1613236133.251139_65.1","section":"bucket.instance","name":"fggivf-2:828f8250-b337-4094-a551-9a6ba396e2f7.4334.2","timestamp":"2021-02-13 17:08:53.251139941Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_I8iLHBQpakCuCLPHXO9q2vN","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236133.253212_66.1","section":"bucket","name":"fggivf-2","timestamp":"2021-02-13 17:08:53.253212610Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E92Hr2Fs_1EA1S3K3EDmI_H","ver":1},"status":{"status":"write"}}},{"id":"1_1613236133.258917_67.1","section":"bucket","name":"fggivf-2","timestamp":"2021-02-13 17:08:53.258917343Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E92Hr2Fs_1EA1S3K3EDmI_H","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236134.406749_68.1","section":"bucket.instance","name":"fggivf-3:828f8250-b337-4094-a551-9a6ba396e2f7.4334.3","timestamp":"2021-02-13 17:08:54.406749728Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9M7LinCV5mR9088T0TcClvf","ver":1},"status":{"status":"write"}}},{"id":"1_1613236134.422269_69.1","section":"bucket.instance","name":"fggivf-3:828f8250-b337-4094-a551-9a6ba396e2f7.4334.3","timestamp":"2021-02-13 17:08:54.422269785Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9M7LinCV5mR9088T0TcClvf","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236134.428721_70.1","section":"bucket","name":"fggivf-3","timestamp":"2021-02-13 17:08:54.428721503Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wk6Qojt3L3LYLYkkItAup_o","ver":1},"status":{"status":"write"}}},{"id":"1_1613236134.444689_71.1","section":"bucket","name":"fggivf-3","timestamp":"2021-02-13 17:08:54.444689615Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wk6Qojt3L3LYLYkkItAup_o","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.770049_72.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.4","timestamp":"2021-02-13 17:08:56.770049312Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WdJWtm6Et68NovSs4Mz-Njd","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.785646_73.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.4","timestamp":"2021-02-13 17:08:56.785646586Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WdJWtm6Et68NovSs4Mz-Njd","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.791980_74.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:08:56.791980224Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zDXyt_VCl0mDYK8kQXK1gB2","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.807148_75.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:08:56.807148902Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zDXyt_VCl0mDYK8kQXK1gB2","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.835479_76.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.5","timestamp":"2021-02-13 17:08:56.835479041Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZeRq4idumAd0kJI7fzA2l-t","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.851468_77.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.5","timestamp":"2021-02-13 17:08:56.851468248Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZeRq4idumAd0kJI7fzA2l-t","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.857413_78.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:08:56.857413919Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E50TYDuCr354gdVlNjyS6_c","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.872838_79.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:08:56.872838900Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E50TYDuCr354gdVlNjyS6_c","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.934850_80.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.6","timestamp":"2021-02-13 17:08:56.934850258Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ie2Iy01UbzbWz5vfABk9fUl","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.951266_81.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.6","timestamp":"2021-02-13 17:08:56.951266414Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ie2Iy01UbzbWz5vfABk9fUl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.957106_82.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:08:56.957106108Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FjsXvYcvMg190djv14ASo-P","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.973626_83.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:08:56.973626594Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FjsXvYcvMg190djv14ASo-P","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.631677_84.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.7","timestamp":"2021-02-13 17:09:02.631677351Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.647548_85.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.7","timestamp":"2021-02-13 17:09:02.647548032Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.653493_86.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:02.653493574Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lrvu-9J8P0Qz9rirKPuLeSg","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.664789_87.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:02.664789113Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lrvu-9J8P0Qz9rirKPuLeSg","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236142.674711_88.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.7","timestamp":"2021-02-13 17:09:02.674711599Z","data":{"read_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":1},"write_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236142.689989_89.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.7","timestamp":"2021-02-13 17:09:02.689989837Z","data":{"read_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":1},"write_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236142.716861_90.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.8","timestamp":"2021-02-13 17:09:02.716861437Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.733587_91.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.8","timestamp":"2021-02-13 17:09:02.733587245Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.739866_92.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:02.739866856Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fEtN4yrcqZzdlH7Obu_wLl8","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.750685_93.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:02.750685926Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fEtN4yrcqZzdlH7Obu_wLl8","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236142.761155_94.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.8","timestamp":"2021-02-13 17:09:02.761155199Z","data":{"read_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":1},"write_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236142.775386_95.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.8","timestamp":"2021-02-13 17:09:02.775386218Z","data":{"read_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":1},"write_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236142.794617_96.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.9","timestamp":"2021-02-13 17:09:02.794617617Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.805719_97.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.9","timestamp":"2021-02-13 17:09:02.805719376Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.810241_98.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:02.810241733Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BbyFGtWq3GDAk_CBCFBVpbK","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.818865_99.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:02.818865566Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BbyFGtWq3GDAk_CBCFBVpbK","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236142.827228_100.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.9","timestamp":"2021-02-13 17:09:02.827228530Z","data":{"read_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":1},"write_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236142.838159_101.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.9","timestamp":"2021-02-13 17:09:02.838159819Z","data":{"read_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":1},"write_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236142.862019_102.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.10","timestamp":"2021-02-13 17:09:02.862019577Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.872078_103.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.10","timestamp":"2021-02-13 17:09:02.872078859Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.875943_104.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:02.875943276Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5Qw8xrxcL9PbNpxRqGzgs-x","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.883891_105.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:02.883891746Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5Qw8xrxcL9PbNpxRqGzgs-x","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236142.891075_106.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.10","timestamp":"2021-02-13 17:09:02.891075869Z","data":{"read_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":1},"write_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236142.901752_107.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.10","timestamp":"2021-02-13 17:09:02.901752455Z","data":{"read_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":1},"write_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236142.959830_108.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.11","timestamp":"2021-02-13 17:09:02.959830129Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.975302_109.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.11","timestamp":"2021-02-13 17:09:02.975302404Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.980644_110.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:02.980644518Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZBgeeoKpk_cVxf28vkNxXEh","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.991050_111.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:02.991050845Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZBgeeoKpk_cVxf28vkNxXEh","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236143.000310_112.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.11","timestamp":"2021-02-13 17:09:03.000310684Z","data":{"read_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":1},"write_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236143.015207_113.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.11","timestamp":"2021-02-13 17:09:03.015207766Z","data":{"read_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":1},"write_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236143.077484_114.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.12","timestamp":"2021-02-13 17:09:03.077484714Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.093641_115.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.12","timestamp":"2021-02-13 17:09:03.093641018Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236143.099932_116.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:03.099932950Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7n3rrkZ1z6GUeQYwqdZWlQc","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.111225_117.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:03.111225751Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7n3rrkZ1z6GUeQYwqdZWlQc","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236143.121091_118.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.12","timestamp":"2021-02-13 17:09:03.121091705Z","data":{"read_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":1},"write_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236143.136215_119.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.12","timestamp":"2021-02-13 17:09:03.136215200Z","data":{"read_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":1},"write_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236143.240544_120.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.13","timestamp":"2021-02-13 17:09:03.240544868Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.256062_121.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.13","timestamp":"2021-02-13 17:09:03.256062169Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236143.261970_122.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:03.261970913Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_c4p9j46Ekxm24ng54KkYX5V","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.273238_123.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:03.273238024Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_c4p9j46Ekxm24ng54KkYX5V","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236143.283107_124.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.13","timestamp":"2021-02-13 17:09:03.283107093Z","data":{"read_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":1},"write_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236143.298002_125.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.13","timestamp":"2021-02-13 17:09:03.298002217Z","data":{"read_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":1},"write_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236143.359814_126.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.14","timestamp":"2021-02-13 17:09:03.359814410Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.375221_127.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.14","timestamp":"2021-02-13 17:09:03.375221646Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236143.381038_128.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:03.381038078Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XvI88UZ1iLAh3aib-aaO9UX","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.391506_129.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:03.391506444Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XvI88UZ1iLAh3aib-aaO9UX","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236143.401486_130.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.14","timestamp":"2021-02-13 17:09:03.401486198Z","data":{"read_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":1},"write_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236143.416837_131.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.14","timestamp":"2021-02-13 17:09:03.416837625Z","data":{"read_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":1},"write_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236143.517883_132.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.15","timestamp":"2021-02-13 17:09:03.517883464Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.533432_133.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.15","timestamp":"2021-02-13 17:09:03.533432357Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236143.539825_134.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:03.539825925Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-z0jqf_7EggFfDdVF7UgGvE","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.551491_135.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:03.551491057Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-z0jqf_7EggFfDdVF7UgGvE","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236143.561428_136.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.15","timestamp":"2021-02-13 17:09:03.561428385Z","data":{"read_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":1},"write_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236143.577282_137.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.15","timestamp":"2021-02-13 17:09:03.577282401Z","data":{"read_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":1},"write_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236159.521655_138.1","section":"bucket.instance","name":"fggivf-7:828f8250-b337-4094-a551-9a6ba396e2f7.4334.16","timestamp":"2021-02-13 17:09:19.521655971Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Novyg1ni_NVvq7E3Sxcuc9j","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.538369_139.1","section":"bucket.instance","name":"fggivf-7:828f8250-b337-4094-a551-9a6ba396e2f7.4334.16","timestamp":"2021-02-13 17:09:19.538369977Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Novyg1ni_NVvq7E3Sxcuc9j","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236159.545091_140.1","section":"bucket","name":"fggivf-7","timestamp":"2021-02-13 17:09:19.545091698Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.562813_141.1","section":"bucket","name":"fggivf-7","timestamp":"2021-02-13 17:09:19.562813463Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236159.592942_142.1","section":"bucket.instance","name":"fggivf-8:828f8250-b337-4094-a551-9a6ba396e2f7.4334.17","timestamp":"2021-02-13 17:09:19.592942571Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rS5HrgXvvd0g20Kc9nZDh57","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.609255_143.1","section":"bucket.instance","name":"fggivf-8:828f8250-b337-4094-a551-9a6ba396e2f7.4334.17","timestamp":"2021-02-13 17:09:19.609255746Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rS5HrgXvvd0g20Kc9nZDh57","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236159.614994_144.1","section":"bucket","name":"fggivf-8","timestamp":"2021-02-13 17:09:19.614994093Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.630344_145.1","section":"bucket","name":"fggivf-8","timestamp":"2021-02-13 17:09:19.630344839Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236159.692632_146.1","section":"bucket.instance","name":"fggivf-9:828f8250-b337-4094-a551-9a6ba396e2f7.4334.18","timestamp":"2021-02-13 17:09:19.692632205Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3Cb1enbvLKK1av5fFEjGanj","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.708401_147.1","section":"bucket.instance","name":"fggivf-9:828f8250-b337-4094-a551-9a6ba396e2f7.4334.18","timestamp":"2021-02-13 17:09:19.708401977Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3Cb1enbvLKK1av5fFEjGanj","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236159.714476_148.1","section":"bucket","name":"fggivf-9","timestamp":"2021-02-13 17:09:19.714476498Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.729777_149.1","section":"bucket","name":"fggivf-9","timestamp":"2021-02-13 17:09:19.729777247Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236165.416017_150.1","section":"bucket","name":"fggivf-7","timestamp":"2021-02-13 17:09:25.416017261Z","data":{"read_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":1},"write_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236165.431937_151.1","section":"bucket","name":"fggivf-7","timestamp":"2021-02-13 17:09:25.431937039Z","data":{"read_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":1},"write_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236165.469186_152.1","section":"bucket","name":"fggivf-8","timestamp":"2021-02-13 17:09:25.469186740Z","data":{"read_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":1},"write_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236165.484451_153.1","section":"bucket","name":"fggivf-8","timestamp":"2021-02-13 17:09:25.484451837Z","data":{"read_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":1},"write_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236165.555023_154.1","section":"bucket","name":"fggivf-9","timestamp":"2021-02-13 17:09:25.555023108Z","data":{"read_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":1},"write_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236165.569853_155.1","section":"bucket","name":"fggivf-9","timestamp":"2021-02-13 17:09:25.569853904Z","data":{"read_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":1},"write_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":2},"status":{"status":"complete"}}}] 2021-02-13T17:49:45.577 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'efc2d01e-ebf2-4522-b313-ef15a0018fb0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:45.578 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'efc2d01e-ebf2-4522-b313-ef15a0018fb0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:45.579 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period efc2d01e-ebf2-4522-b313-ef15a0018fb0 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:45.714 INFO:teuthology.orchestra.run.gibba037.stdout:[{"id":"1_1613236014.099941_62.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-02-13 17:06:54.099941197Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-EqbQ-5-T-VOn7NS4I-3wpD","ver":1},"status":{"status":"write"}}},{"id":"1_1613236014.104172_63.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-02-13 17:06:54.104172306Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-EqbQ-5-T-VOn7NS4I-3wpD","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.196438_53.1","section":"bucket.instance","name":"fggivf-10:828f8250-b337-4094-a551-9a6ba396e2f7.4334.19","timestamp":"2021-02-13 17:09:31.196438735Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VqIo9kuwkG0XTnFoSK7eyK-","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.212307_54.1","section":"bucket.instance","name":"fggivf-10:828f8250-b337-4094-a551-9a6ba396e2f7.4334.19","timestamp":"2021-02-13 17:09:31.212307438Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VqIo9kuwkG0XTnFoSK7eyK-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.217988_55.1","section":"bucket","name":"fggivf-10","timestamp":"2021-02-13 17:09:31.217988294Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nxPcI_eGiafcaXWPcfqb5Vk","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.234221_56.1","section":"bucket","name":"fggivf-10","timestamp":"2021-02-13 17:09:31.234221933Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nxPcI_eGiafcaXWPcfqb5Vk","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.263723_57.1","section":"bucket.instance","name":"fggivf-11:828f8250-b337-4094-a551-9a6ba396e2f7.4334.20","timestamp":"2021-02-13 17:09:31.263723814Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bHDXjSYpcZqa8cF13iKmv-Z","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.280955_58.1","section":"bucket.instance","name":"fggivf-11:828f8250-b337-4094-a551-9a6ba396e2f7.4334.20","timestamp":"2021-02-13 17:09:31.280955898Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bHDXjSYpcZqa8cF13iKmv-Z","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.286667_59.1","section":"bucket","name":"fggivf-11","timestamp":"2021-02-13 17:09:31.286667194Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Et04VXAHGO2T4lGwRveYoQ1","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.302019_60.1","section":"bucket","name":"fggivf-11","timestamp":"2021-02-13 17:09:31.302019141Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Et04VXAHGO2T4lGwRveYoQ1","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.364279_61.1","section":"bucket.instance","name":"fggivf-12:828f8250-b337-4094-a551-9a6ba396e2f7.4334.21","timestamp":"2021-02-13 17:09:31.364279946Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oseyFAJlhQNqzgInpGtp0TD","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.380702_62.1","section":"bucket.instance","name":"fggivf-12:828f8250-b337-4094-a551-9a6ba396e2f7.4334.21","timestamp":"2021-02-13 17:09:31.380702382Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oseyFAJlhQNqzgInpGtp0TD","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.386265_63.1","section":"bucket","name":"fggivf-12","timestamp":"2021-02-13 17:09:31.386265156Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WbAeBcLswvqM1wd_YAUaTIh","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.401277_64.1","section":"bucket","name":"fggivf-12","timestamp":"2021-02-13 17:09:31.401277752Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WbAeBcLswvqM1wd_YAUaTIh","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.685309_71.1","section":"bucket.instance","name":"fggivf-13:828f8250-b337-4094-a551-9a6ba396e2f7.4334.22","timestamp":"2021-02-13 17:14:54.685309265Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bet3NdQXYKvr67yifwstqHa","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.701763_72.1","section":"bucket.instance","name":"fggivf-13:828f8250-b337-4094-a551-9a6ba396e2f7.4334.22","timestamp":"2021-02-13 17:14:54.701763932Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bet3NdQXYKvr67yifwstqHa","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.707087_73.1","section":"bucket","name":"fggivf-13","timestamp":"2021-02-13 17:14:54.707087471Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_B3O8SPnFCECzDcoGwLitIc4","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.722191_74.1","section":"bucket","name":"fggivf-13","timestamp":"2021-02-13 17:14:54.722191389Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_B3O8SPnFCECzDcoGwLitIc4","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.756933_75.1","section":"bucket.instance","name":"fggivf-14:828f8250-b337-4094-a551-9a6ba396e2f7.4334.23","timestamp":"2021-02-13 17:14:54.756933058Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bSUE5kl9CAXtByR8WRHpzt1","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.772874_76.1","section":"bucket.instance","name":"fggivf-14:828f8250-b337-4094-a551-9a6ba396e2f7.4334.23","timestamp":"2021-02-13 17:14:54.772874859Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bSUE5kl9CAXtByR8WRHpzt1","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.778694_77.1","section":"bucket","name":"fggivf-14","timestamp":"2021-02-13 17:14:54.778694733Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RklCZ_OXWLx7fnH2DF-eHxz","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.794815_78.1","section":"bucket","name":"fggivf-14","timestamp":"2021-02-13 17:14:54.794815276Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RklCZ_OXWLx7fnH2DF-eHxz","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.859459_79.1","section":"bucket.instance","name":"fggivf-15:828f8250-b337-4094-a551-9a6ba396e2f7.4334.24","timestamp":"2021-02-13 17:14:54.859459452Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Siw_0gtpVKdXR543NrVsJzq","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.875105_80.1","section":"bucket.instance","name":"fggivf-15:828f8250-b337-4094-a551-9a6ba396e2f7.4334.24","timestamp":"2021-02-13 17:14:54.875105442Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Siw_0gtpVKdXR543NrVsJzq","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.881339_81.1","section":"bucket","name":"fggivf-15","timestamp":"2021-02-13 17:14:54.881339509Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wfRCCKCutoHS32Z_LKOhZ-_","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.899000_82.1","section":"bucket","name":"fggivf-15","timestamp":"2021-02-13 17:14:54.899000450Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wfRCCKCutoHS32Z_LKOhZ-_","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.351934_98.1","section":"bucket.instance","name":"fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","timestamp":"2021-02-13 17:20:14.351934045Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.367986_99.1","section":"bucket.instance","name":"fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","timestamp":"2021-02-13 17:20:14.367986747Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.373839_100.1","section":"bucket","name":"fggivf-16","timestamp":"2021-02-13 17:20:14.373839766Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Wgs25dS8grYhXa5RLNPolFM","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.389049_101.1","section":"bucket","name":"fggivf-16","timestamp":"2021-02-13 17:20:14.389049062Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Wgs25dS8grYhXa5RLNPolFM","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.452556_102.1","section":"bucket.instance","name":"fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","timestamp":"2021-02-13 17:20:14.452556828Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.467356_103.1","section":"bucket.instance","name":"fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","timestamp":"2021-02-13 17:20:14.467356976Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.473165_104.1","section":"bucket","name":"fggivf-17","timestamp":"2021-02-13 17:20:14.473165220Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WK43gg7njPFFdyncspZKr6N","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.488426_105.1","section":"bucket","name":"fggivf-17","timestamp":"2021-02-13 17:20:14.488426065Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WK43gg7njPFFdyncspZKr6N","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.557187_106.1","section":"bucket.instance","name":"fggivf-18:828f8250-b337-4094-a551-9a6ba396e2f7.4334.27","timestamp":"2021-02-13 17:20:14.557187293Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.572460_107.1","section":"bucket.instance","name":"fggivf-18:828f8250-b337-4094-a551-9a6ba396e2f7.4334.27","timestamp":"2021-02-13 17:20:14.572460177Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.577949_108.1","section":"bucket","name":"fggivf-18","timestamp":"2021-02-13 17:20:14.577949325Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2LHX0c0R1XPMZ0M8-TFhz44","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.592532_109.1","section":"bucket","name":"fggivf-18","timestamp":"2021-02-13 17:20:14.592532320Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2LHX0c0R1XPMZ0M8-TFhz44","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.639959_110.1","section":"bucket.instance","name":"fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","timestamp":"2021-02-13 17:20:14.639959058Z","data":{"read_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":1},"write_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":2},"status":{"status":"write"}}},{"id":"1_1613236814.655562_111.1","section":"bucket.instance","name":"fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","timestamp":"2021-02-13 17:20:14.655562406Z","data":{"read_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":1},"write_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236814.665189_112.1","section":"bucket.instance","name":"fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","timestamp":"2021-02-13 17:20:14.665189301Z","data":{"read_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":1},"write_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":2},"status":{"status":"write"}}},{"id":"1_1613236814.681183_113.1","section":"bucket.instance","name":"fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","timestamp":"2021-02-13 17:20:14.681183928Z","data":{"read_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":1},"write_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236814.701746_114.1","section":"bucket.instance","name":"fggivf-18:828f8250-b337-4094-a551-9a6ba396e2f7.4334.27","timestamp":"2021-02-13 17:20:14.701746389Z","data":{"read_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":1},"write_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":2},"status":{"status":"write"}}},{"id":"1_1613236814.717897_115.1","section":"bucket.instance","name":"fggivf-18:828f8250-b337-4094-a551-9a6ba396e2f7.4334.27","timestamp":"2021-02-13 17:20:14.717897308Z","data":{"read_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":1},"write_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":2},"status":{"status":"complete"}}},{"id":"1_1613237142.622184_121.1","section":"bucket.instance","name":"fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","timestamp":"2021-02-13 17:25:42.622184525Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":1},"status":{"status":"write"}}},{"id":"1_1613237142.637550_122.1","section":"bucket.instance","name":"fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","timestamp":"2021-02-13 17:25:42.637550077Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237142.643141_123.1","section":"bucket","name":"fggivf-19","timestamp":"2021-02-13 17:25:42.643141946Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vNd2GKIsAUed0Y8dIy7JYVk","ver":1},"status":{"status":"write"}}},{"id":"1_1613237142.659069_124.1","section":"bucket","name":"fggivf-19","timestamp":"2021-02-13 17:25:42.659069522Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vNd2GKIsAUed0Y8dIy7JYVk","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237142.676967_125.1","section":"bucket.instance","name":"fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","timestamp":"2021-02-13 17:25:42.676967515Z","data":{"read_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":1},"write_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":2},"status":{"status":"write"}}},{"id":"1_1613237142.691994_126.1","section":"bucket.instance","name":"fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","timestamp":"2021-02-13 17:25:42.691994132Z","data":{"read_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":1},"write_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":2},"status":{"status":"complete"}}},{"id":"1_1613237465.669610_143.1","section":"bucket.instance","name":"fggivf-20:828f8250-b337-4094-a551-9a6ba396e2f7.4334.29","timestamp":"2021-02-13 17:31:05.669610151Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iAu6k8sFyJ8ucyuC09n-JOP","ver":1},"status":{"status":"write"}}},{"id":"1_1613237465.684813_144.1","section":"bucket.instance","name":"fggivf-20:828f8250-b337-4094-a551-9a6ba396e2f7.4334.29","timestamp":"2021-02-13 17:31:05.684813775Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iAu6k8sFyJ8ucyuC09n-JOP","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237465.690336_145.1","section":"bucket","name":"fggivf-20","timestamp":"2021-02-13 17:31:05.690336750Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kvL_VY8rpUJDn8f_Pwd8jyv","ver":1},"status":{"status":"write"}}},{"id":"1_1613237465.705456_146.1","section":"bucket","name":"fggivf-20","timestamp":"2021-02-13 17:31:05.705456444Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kvL_VY8rpUJDn8f_Pwd8jyv","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.761810_152.1","section":"bucket.instance","name":"fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","timestamp":"2021-02-13 17:36:28.761810479Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.776807_153.1","section":"bucket.instance","name":"fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","timestamp":"2021-02-13 17:36:28.776807744Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.782089_154.1","section":"bucket","name":"fggivf-21","timestamp":"2021-02-13 17:36:28.782089078Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SAq4BYH3EwV0UU61VP1pejU","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.796754_155.1","section":"bucket","name":"fggivf-21","timestamp":"2021-02-13 17:36:28.796754434Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SAq4BYH3EwV0UU61VP1pejU","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.838589_156.1","section":"bucket.instance","name":"fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","timestamp":"2021-02-13 17:36:28.838589398Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.853961_157.1","section":"bucket.instance","name":"fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","timestamp":"2021-02-13 17:36:28.853961735Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.859505_158.1","section":"bucket","name":"fggivf-22","timestamp":"2021-02-13 17:36:28.859505636Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eCxNTRRU6vroIYjjBDnY5XZ","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.874384_159.1","section":"bucket","name":"fggivf-22","timestamp":"2021-02-13 17:36:28.874384442Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eCxNTRRU6vroIYjjBDnY5XZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.945045_160.1","section":"bucket.instance","name":"fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","timestamp":"2021-02-13 17:36:28.945045451Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.960629_161.1","section":"bucket.instance","name":"fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","timestamp":"2021-02-13 17:36:28.960629424Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.966694_162.1","section":"bucket","name":"fggivf-23","timestamp":"2021-02-13 17:36:28.966694385Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DSTm1o5MsVn7oaPFz55_QQo","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.980647_163.1","section":"bucket","name":"fggivf-23","timestamp":"2021-02-13 17:36:28.980647568Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DSTm1o5MsVn7oaPFz55_QQo","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237789.025752_164.1","section":"bucket.instance","name":"fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","timestamp":"2021-02-13 17:36:29.025752790Z","data":{"read_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":1},"write_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":2},"status":{"status":"write"}}},{"id":"1_1613237789.040157_165.1","section":"bucket.instance","name":"fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","timestamp":"2021-02-13 17:36:29.040157273Z","data":{"read_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":1},"write_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":2},"status":{"status":"complete"}}},{"id":"1_1613237789.053244_166.1","section":"bucket.instance","name":"fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","timestamp":"2021-02-13 17:36:29.053244209Z","data":{"read_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":1},"write_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":2},"status":{"status":"write"}}},{"id":"1_1613237789.068914_167.1","section":"bucket.instance","name":"fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","timestamp":"2021-02-13 17:36:29.068914555Z","data":{"read_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":1},"write_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":2},"status":{"status":"complete"}}},{"id":"1_1613237789.092382_168.1","section":"bucket.instance","name":"fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","timestamp":"2021-02-13 17:36:29.092382493Z","data":{"read_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":1},"write_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":2},"status":{"status":"write"}}},{"id":"1_1613237789.107690_169.1","section":"bucket.instance","name":"fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","timestamp":"2021-02-13 17:36:29.107690528Z","data":{"read_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":1},"write_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238112.432178_186.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.432178658Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.447711_187.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.447711839Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.453484_188.1","section":"bucket","name":"fggivf-24","timestamp":"2021-02-13 17:41:52.453484095Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GQBIz3Bmn45tGg3QZpgBzLl","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.468700_189.1","section":"bucket","name":"fggivf-24","timestamp":"2021-02-13 17:41:52.468700608Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GQBIz3Bmn45tGg3QZpgBzLl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.502635_190.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.502635621Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.517751_191.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.517751746Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.523727_192.1","section":"bucket","name":"fggivf-25","timestamp":"2021-02-13 17:41:52.523727660Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9QZ2f9ENO66rg0kQaL0rCKO","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.538746_193.1","section":"bucket","name":"fggivf-25","timestamp":"2021-02-13 17:41:52.538746514Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9QZ2f9ENO66rg0kQaL0rCKO","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.603353_194.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.603353685Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.619142_195.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.619142346Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.625305_196.1","section":"bucket","name":"fggivf-26","timestamp":"2021-02-13 17:41:52.625305155Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fWUBwfHqYL3oqMcQx9P7R8A","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.640724_197.1","section":"bucket","name":"fggivf-26","timestamp":"2021-02-13 17:41:52.640724565Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fWUBwfHqYL3oqMcQx9P7R8A","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.693308_198.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.693308506Z","data":{"read_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":1},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":2},"status":{"status":"write"}}},{"id":"1_1613238112.708606_199.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.708606961Z","data":{"read_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":1},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238112.718551_200.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.718551598Z","data":{"read_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":2},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":3},"status":{"status":"write"}}},{"id":"1_1613238112.733710_201.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.733710194Z","data":{"read_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":2},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":3},"status":{"status":"complete"}}},{"id":"1_1613238112.747048_202.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.747048544Z","data":{"read_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":1},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":2},"status":{"status":"write"}}},{"id":"1_1613238112.762327_203.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.762327000Z","data":{"read_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":1},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238112.791260_204.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.791260146Z","data":{"read_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":2},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":3},"status":{"status":"write"}}},{"id":"1_1613238112.807174_205.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.807174414Z","data":{"read_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":2},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":3},"status":{"status":"complete"}}},{"id":"1_1613238112.831806_206.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.831806374Z","data":{"read_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":1},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":2},"status":{"status":"write"}}},{"id":"1_1613238112.847291_207.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.847291901Z","data":{"read_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":1},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238112.871196_208.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.871196235Z","data":{"read_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":2},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":3},"status":{"status":"write"}}},{"id":"1_1613238112.886659_209.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.886659003Z","data":{"read_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":2},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":3},"status":{"status":"complete"}}},{"id":"1_1613238431.110994_232.1","section":"bucket.instance","name":"fggivf-27:828f8250-b337-4094-a551-9a6ba396e2f7.4334.36","timestamp":"2021-02-13 17:47:11.110994447Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.126328_233.1","section":"bucket.instance","name":"fggivf-27:828f8250-b337-4094-a551-9a6ba396e2f7.4334.36","timestamp":"2021-02-13 17:47:11.126328287Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.131489_234.1","section":"bucket","name":"fggivf-27","timestamp":"2021-02-13 17:47:11.131489568Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6Cy8XaR4r9WYhv_ztFn-mpf","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.146258_235.1","section":"bucket","name":"fggivf-27","timestamp":"2021-02-13 17:47:11.146258185Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6Cy8XaR4r9WYhv_ztFn-mpf","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.177639_236.1","section":"bucket.instance","name":"fggivf-28:828f8250-b337-4094-a551-9a6ba396e2f7.4334.37","timestamp":"2021-02-13 17:47:11.177639803Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.192729_237.1","section":"bucket.instance","name":"fggivf-28:828f8250-b337-4094-a551-9a6ba396e2f7.4334.37","timestamp":"2021-02-13 17:47:11.192729594Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.198158_238.1","section":"bucket","name":"fggivf-28","timestamp":"2021-02-13 17:47:11.198158261Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PA91Z3oPFW8M03bxnilmzO5","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.213216_239.1","section":"bucket","name":"fggivf-28","timestamp":"2021-02-13 17:47:11.213216863Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PA91Z3oPFW8M03bxnilmzO5","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.275134_240.1","section":"bucket.instance","name":"fggivf-29:828f8250-b337-4094-a551-9a6ba396e2f7.4334.38","timestamp":"2021-02-13 17:47:11.275134983Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.291290_241.1","section":"bucket.instance","name":"fggivf-29:828f8250-b337-4094-a551-9a6ba396e2f7.4334.38","timestamp":"2021-02-13 17:47:11.291290727Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.297391_242.1","section":"bucket","name":"fggivf-29","timestamp":"2021-02-13 17:47:11.297391016Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hkei1McsRKCT8pKcR36qyoK","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.313623_243.1","section":"bucket","name":"fggivf-29","timestamp":"2021-02-13 17:47:11.313623171Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hkei1McsRKCT8pKcR36qyoK","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.357873_244.1","section":"bucket.instance","name":"fggivf-27:828f8250-b337-4094-a551-9a6ba396e2f7.4334.36","timestamp":"2021-02-13 17:47:11.357873884Z","data":{"read_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":1},"write_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":2},"status":{"status":"write"}}},{"id":"1_1613238431.373561_245.1","section":"bucket.instance","name":"fggivf-27:828f8250-b337-4094-a551-9a6ba396e2f7.4334.36","timestamp":"2021-02-13 17:47:11.373561834Z","data":{"read_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":1},"write_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238431.431448_246.1","section":"bucket.instance","name":"fggivf-28:828f8250-b337-4094-a551-9a6ba396e2f7.4334.37","timestamp":"2021-02-13 17:47:11.431448394Z","data":{"read_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":1},"write_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":2},"status":{"status":"write"}}},{"id":"1_1613238431.448264_247.1","section":"bucket.instance","name":"fggivf-28:828f8250-b337-4094-a551-9a6ba396e2f7.4334.37","timestamp":"2021-02-13 17:47:11.448264002Z","data":{"read_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":1},"write_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238431.514051_248.1","section":"bucket.instance","name":"fggivf-29:828f8250-b337-4094-a551-9a6ba396e2f7.4334.38","timestamp":"2021-02-13 17:47:11.514051259Z","data":{"read_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":1},"write_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":2},"status":{"status":"write"}}},{"id":"1_1613238431.529019_249.1","section":"bucket.instance","name":"fggivf-29:828f8250-b337-4094-a551-9a6ba396e2f7.4334.38","timestamp":"2021-02-13 17:47:11.529019779Z","data":{"read_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":1},"write_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238431.604115_250.1","section":"bucket.instance","name":"fggivf-30:828f8250-b337-4094-a551-9a6ba396e2f7.4334.39","timestamp":"2021-02-13 17:47:11.604115910Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.620570_251.1","section":"bucket.instance","name":"fggivf-30:828f8250-b337-4094-a551-9a6ba396e2f7.4334.39","timestamp":"2021-02-13 17:47:11.620570555Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.626060_252.1","section":"bucket","name":"fggivf-30","timestamp":"2021-02-13 17:47:11.626060648Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iZD09tXPcC9vaV2z68fQzCF","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.641220_253.1","section":"bucket","name":"fggivf-30","timestamp":"2021-02-13 17:47:11.641220907Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iZD09tXPcC9vaV2z68fQzCF","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.670263_254.1","section":"bucket.instance","name":"fggivf-31:828f8250-b337-4094-a551-9a6ba396e2f7.4334.40","timestamp":"2021-02-13 17:47:11.670263825Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.685325_255.1","section":"bucket.instance","name":"fggivf-31:828f8250-b337-4094-a551-9a6ba396e2f7.4334.40","timestamp":"2021-02-13 17:47:11.685325015Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.691225_256.1","section":"bucket","name":"fggivf-31","timestamp":"2021-02-13 17:47:11.691225792Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GPZ6dExScYRc4voXrZgR_-d","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.706046_257.1","section":"bucket","name":"fggivf-31","timestamp":"2021-02-13 17:47:11.706046764Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GPZ6dExScYRc4voXrZgR_-d","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.769586_258.1","section":"bucket.instance","name":"fggivf-32:828f8250-b337-4094-a551-9a6ba396e2f7.4334.41","timestamp":"2021-02-13 17:47:11.769586952Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.786167_259.1","section":"bucket.instance","name":"fggivf-32:828f8250-b337-4094-a551-9a6ba396e2f7.4334.41","timestamp":"2021-02-13 17:47:11.786167576Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.792407_260.1","section":"bucket","name":"fggivf-32","timestamp":"2021-02-13 17:47:11.792407276Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BMNwg0clYxO4nk3eV73Facz","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.807305_261.1","section":"bucket","name":"fggivf-32","timestamp":"2021-02-13 17:47:11.807305878Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BMNwg0clYxO4nk3eV73Facz","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.854693_262.1","section":"bucket.instance","name":"fggivf-30:828f8250-b337-4094-a551-9a6ba396e2f7.4334.39","timestamp":"2021-02-13 17:47:11.854693585Z","data":{"read_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":1},"write_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":2},"status":{"status":"write"}}},{"id":"1_1613238431.869998_263.1","section":"bucket.instance","name":"fggivf-30:828f8250-b337-4094-a551-9a6ba396e2f7.4334.39","timestamp":"2021-02-13 17:47:11.869998434Z","data":{"read_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":1},"write_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238431.924481_264.1","section":"bucket.instance","name":"fggivf-31:828f8250-b337-4094-a551-9a6ba396e2f7.4334.40","timestamp":"2021-02-13 17:47:11.924481477Z","data":{"read_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":1},"write_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":2},"status":{"status":"write"}}},{"id":"1_1613238431.939618_265.1","section":"bucket.instance","name":"fggivf-31:828f8250-b337-4094-a551-9a6ba396e2f7.4334.40","timestamp":"2021-02-13 17:47:11.939618544Z","data":{"read_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":1},"write_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238432.012666_266.1","section":"bucket.instance","name":"fggivf-32:828f8250-b337-4094-a551-9a6ba396e2f7.4334.41","timestamp":"2021-02-13 17:47:12.012666100Z","data":{"read_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":1},"write_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":2},"status":{"status":"write"}}},{"id":"1_1613238432.029467_267.1","section":"bucket.instance","name":"fggivf-32:828f8250-b337-4094-a551-9a6ba396e2f7.4334.41","timestamp":"2021-02-13 17:47:12.029467966Z","data":{"read_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":1},"write_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238432.104055_268.1","section":"bucket.instance","name":"fggivf-33:828f8250-b337-4094-a551-9a6ba396e2f7.4334.42","timestamp":"2021-02-13 17:47:12.104055309Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.119795_269.1","section":"bucket.instance","name":"fggivf-33:828f8250-b337-4094-a551-9a6ba396e2f7.4334.42","timestamp":"2021-02-13 17:47:12.119795519Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.125075_270.1","section":"bucket","name":"fggivf-33","timestamp":"2021-02-13 17:47:12.125075320Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_gw_ofPwNHQ1fSnVedLiAcTj","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.139354_271.1","section":"bucket","name":"fggivf-33","timestamp":"2021-02-13 17:47:12.139354982Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_gw_ofPwNHQ1fSnVedLiAcTj","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.168601_272.1","section":"bucket.instance","name":"fggivf-34:828f8250-b337-4094-a551-9a6ba396e2f7.4334.43","timestamp":"2021-02-13 17:47:12.168601856Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.184386_273.1","section":"bucket.instance","name":"fggivf-34:828f8250-b337-4094-a551-9a6ba396e2f7.4334.43","timestamp":"2021-02-13 17:47:12.184386478Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.190106_274.1","section":"bucket","name":"fggivf-34","timestamp":"2021-02-13 17:47:12.190106317Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_aaLW-3YhFzLY9wSTlsDn6tM","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.205963_275.1","section":"bucket","name":"fggivf-34","timestamp":"2021-02-13 17:47:12.205963360Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_aaLW-3YhFzLY9wSTlsDn6tM","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.248026_276.1","section":"bucket.instance","name":"fggivf-35:828f8250-b337-4094-a551-9a6ba396e2f7.4334.44","timestamp":"2021-02-13 17:47:12.248026075Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.253923_277.1","section":"bucket.instance","name":"fggivf-35:828f8250-b337-4094-a551-9a6ba396e2f7.4334.44","timestamp":"2021-02-13 17:47:12.253923030Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.255524_278.1","section":"bucket","name":"fggivf-35","timestamp":"2021-02-13 17:47:12.255524489Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rojmW78rwGJU-nwoki0xa0F","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.259703_279.1","section":"bucket","name":"fggivf-35","timestamp":"2021-02-13 17:47:12.259703553Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rojmW78rwGJU-nwoki0xa0F","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.271275_280.1","section":"bucket.instance","name":"fggivf-33:828f8250-b337-4094-a551-9a6ba396e2f7.4334.42","timestamp":"2021-02-13 17:47:12.271275645Z","data":{"read_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":1},"write_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":2},"status":{"status":"write"}}},{"id":"1_1613238432.274462_281.1","section":"bucket.instance","name":"fggivf-33:828f8250-b337-4094-a551-9a6ba396e2f7.4334.42","timestamp":"2021-02-13 17:47:12.274462102Z","data":{"read_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":1},"write_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238433.322337_282.1","section":"bucket.instance","name":"fggivf-34:828f8250-b337-4094-a551-9a6ba396e2f7.4334.43","timestamp":"2021-02-13 17:47:13.322337702Z","data":{"read_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":1},"write_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":2},"status":{"status":"write"}}},{"id":"1_1613238433.338648_283.1","section":"bucket.instance","name":"fggivf-34:828f8250-b337-4094-a551-9a6ba396e2f7.4334.43","timestamp":"2021-02-13 17:47:13.338648163Z","data":{"read_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":1},"write_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238434.403111_284.1","section":"bucket.instance","name":"fggivf-35:828f8250-b337-4094-a551-9a6ba396e2f7.4334.44","timestamp":"2021-02-13 17:47:14.403111689Z","data":{"read_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":1},"write_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":2},"status":{"status":"write"}}},{"id":"1_1613238434.419714_285.1","section":"bucket.instance","name":"fggivf-35:828f8250-b337-4094-a551-9a6ba396e2f7.4334.44","timestamp":"2021-02-13 17:47:14.419714729Z","data":{"read_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":1},"write_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238434.495955_286.1","section":"bucket.instance","name":"fggivf-36:828f8250-b337-4094-a551-9a6ba396e2f7.4334.45","timestamp":"2021-02-13 17:47:14.495955275Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oFRvoHby-NEbuPiJg1Te1nF","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.511160_287.1","section":"bucket.instance","name":"fggivf-36:828f8250-b337-4094-a551-9a6ba396e2f7.4334.45","timestamp":"2021-02-13 17:47:14.511160668Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oFRvoHby-NEbuPiJg1Te1nF","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238434.516676_288.1","section":"bucket","name":"fggivf-36","timestamp":"2021-02-13 17:47:14.516676016Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bsQF25cf8hm7Sy5HS8anb54","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.531725_289.1","section":"bucket","name":"fggivf-36","timestamp":"2021-02-13 17:47:14.531725888Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bsQF25cf8hm7Sy5HS8anb54","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238434.567713_290.1","section":"bucket.instance","name":"fggivf-37:828f8250-b337-4094-a551-9a6ba396e2f7.4334.46","timestamp":"2021-02-13 17:47:14.567713005Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2koJCBhqViBn12TfgX4YTUi","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.583305_291.1","section":"bucket.instance","name":"fggivf-37:828f8250-b337-4094-a551-9a6ba396e2f7.4334.46","timestamp":"2021-02-13 17:47:14.583305306Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2koJCBhqViBn12TfgX4YTUi","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238434.589447_292.1","section":"bucket","name":"fggivf-37","timestamp":"2021-02-13 17:47:14.589447349Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xW11GxEwkt4pAdn-VhA3qWS","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.604868_293.1","section":"bucket","name":"fggivf-37","timestamp":"2021-02-13 17:47:14.604868280Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xW11GxEwkt4pAdn-VhA3qWS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238434.650663_295.1","section":"bucket.instance","name":"fggivf-38:828f8250-b337-4094-a551-9a6ba396e2f7.4334.47","timestamp":"2021-02-13 17:47:14.650663028Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PyQEbBLGkQ7_rBTmEDUkRDC","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.666398_296.1","section":"bucket.instance","name":"fggivf-38:828f8250-b337-4094-a551-9a6ba396e2f7.4334.47","timestamp":"2021-02-13 17:47:14.666398024Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PyQEbBLGkQ7_rBTmEDUkRDC","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238434.672194_297.1","section":"bucket","name":"fggivf-38","timestamp":"2021-02-13 17:47:14.672194433Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_tjB7sDK6SUz9uQt09EnxrA-","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.687444_298.1","section":"bucket","name":"fggivf-38","timestamp":"2021-02-13 17:47:14.687444045Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_tjB7sDK6SUz9uQt09EnxrA-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.659651_300.1","section":"bucket.instance","name":"fggivf-39:828f8250-b337-4094-a551-9a6ba396e2f7.4334.48","timestamp":"2021-02-13 17:47:20.659651295Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRK0CQi4K46Bh4QGj_5s4_n","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.675138_301.1","section":"bucket.instance","name":"fggivf-39:828f8250-b337-4094-a551-9a6ba396e2f7.4334.48","timestamp":"2021-02-13 17:47:20.675138034Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRK0CQi4K46Bh4QGj_5s4_n","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.681181_302.1","section":"bucket","name":"fggivf-39","timestamp":"2021-02-13 17:47:20.681181347Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cESFBjz-87rQcSednZLukn-","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.696424_303.1","section":"bucket","name":"fggivf-39","timestamp":"2021-02-13 17:47:20.696424972Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cESFBjz-87rQcSednZLukn-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.727667_304.1","section":"bucket.instance","name":"fggivf-40:828f8250-b337-4094-a551-9a6ba396e2f7.4334.49","timestamp":"2021-02-13 17:47:20.727667170Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2qczbG02DjkZx6nFdSZxPcL","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.742714_305.1","section":"bucket.instance","name":"fggivf-40:828f8250-b337-4094-a551-9a6ba396e2f7.4334.49","timestamp":"2021-02-13 17:47:20.742714068Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2qczbG02DjkZx6nFdSZxPcL","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.748897_306.1","section":"bucket","name":"fggivf-40","timestamp":"2021-02-13 17:47:20.748897447Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TmOyP1ZOYT9s4C5LGSsa8vl","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.764655_307.1","section":"bucket","name":"fggivf-40","timestamp":"2021-02-13 17:47:20.764655264Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TmOyP1ZOYT9s4C5LGSsa8vl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.827123_308.1","section":"bucket.instance","name":"fggivf-41:828f8250-b337-4094-a551-9a6ba396e2f7.4334.50","timestamp":"2021-02-13 17:47:20.827123309Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9XnLu93FXeHDofkHecbNN4b","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.842604_309.1","section":"bucket.instance","name":"fggivf-41:828f8250-b337-4094-a551-9a6ba396e2f7.4334.50","timestamp":"2021-02-13 17:47:20.842604793Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9XnLu93FXeHDofkHecbNN4b","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.848608_310.1","section":"bucket","name":"fggivf-41","timestamp":"2021-02-13 17:47:20.848608585Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZHh9J55KBd7MkjO5SBk-vLh","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.864145_311.1","section":"bucket","name":"fggivf-41","timestamp":"2021-02-13 17:47:20.864145723Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZHh9J55KBd7MkjO5SBk-vLh","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236133.197550_60.1","section":"bucket.instance","name":"fggivf-1:828f8250-b337-4094-a551-9a6ba396e2f7.4334.1","timestamp":"2021-02-13 17:08:53.197550882Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iwYERTwinHDhKEpW-rqBzp8","ver":1},"status":{"status":"write"}}},{"id":"1_1613236133.200947_61.1","section":"bucket.instance","name":"fggivf-1:828f8250-b337-4094-a551-9a6ba396e2f7.4334.1","timestamp":"2021-02-13 17:08:53.200947177Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iwYERTwinHDhKEpW-rqBzp8","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236133.202478_62.1","section":"bucket","name":"fggivf-1","timestamp":"2021-02-13 17:08:53.202478220Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LPYv-FdecuYmtn9SSLy-JHZ","ver":1},"status":{"status":"write"}}},{"id":"1_1613236133.206582_63.1","section":"bucket","name":"fggivf-1","timestamp":"2021-02-13 17:08:53.206582584Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LPYv-FdecuYmtn9SSLy-JHZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236133.246153_64.1","section":"bucket.instance","name":"fggivf-2:828f8250-b337-4094-a551-9a6ba396e2f7.4334.2","timestamp":"2021-02-13 17:08:53.246153618Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_I8iLHBQpakCuCLPHXO9q2vN","ver":1},"status":{"status":"write"}}},{"id":"1_1613236133.251139_65.1","section":"bucket.instance","name":"fggivf-2:828f8250-b337-4094-a551-9a6ba396e2f7.4334.2","timestamp":"2021-02-13 17:08:53.251139941Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_I8iLHBQpakCuCLPHXO9q2vN","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236133.253212_66.1","section":"bucket","name":"fggivf-2","timestamp":"2021-02-13 17:08:53.253212610Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E92Hr2Fs_1EA1S3K3EDmI_H","ver":1},"status":{"status":"write"}}},{"id":"1_1613236133.258917_67.1","section":"bucket","name":"fggivf-2","timestamp":"2021-02-13 17:08:53.258917343Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E92Hr2Fs_1EA1S3K3EDmI_H","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236134.406749_68.1","section":"bucket.instance","name":"fggivf-3:828f8250-b337-4094-a551-9a6ba396e2f7.4334.3","timestamp":"2021-02-13 17:08:54.406749728Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9M7LinCV5mR9088T0TcClvf","ver":1},"status":{"status":"write"}}},{"id":"1_1613236134.422269_69.1","section":"bucket.instance","name":"fggivf-3:828f8250-b337-4094-a551-9a6ba396e2f7.4334.3","timestamp":"2021-02-13 17:08:54.422269785Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9M7LinCV5mR9088T0TcClvf","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236134.428721_70.1","section":"bucket","name":"fggivf-3","timestamp":"2021-02-13 17:08:54.428721503Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wk6Qojt3L3LYLYkkItAup_o","ver":1},"status":{"status":"write"}}},{"id":"1_1613236134.444689_71.1","section":"bucket","name":"fggivf-3","timestamp":"2021-02-13 17:08:54.444689615Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wk6Qojt3L3LYLYkkItAup_o","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.770049_72.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.4","timestamp":"2021-02-13 17:08:56.770049312Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WdJWtm6Et68NovSs4Mz-Njd","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.785646_73.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.4","timestamp":"2021-02-13 17:08:56.785646586Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WdJWtm6Et68NovSs4Mz-Njd","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.791980_74.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:08:56.791980224Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zDXyt_VCl0mDYK8kQXK1gB2","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.807148_75.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:08:56.807148902Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zDXyt_VCl0mDYK8kQXK1gB2","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.835479_76.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.5","timestamp":"2021-02-13 17:08:56.835479041Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZeRq4idumAd0kJI7fzA2l-t","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.851468_77.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.5","timestamp":"2021-02-13 17:08:56.851468248Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZeRq4idumAd0kJI7fzA2l-t","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.857413_78.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:08:56.857413919Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E50TYDuCr354gdVlNjyS6_c","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.872838_79.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:08:56.872838900Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E50TYDuCr354gdVlNjyS6_c","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.934850_80.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.6","timestamp":"2021-02-13 17:08:56.934850258Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ie2Iy01UbzbWz5vfABk9fUl","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.951266_81.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.6","timestamp":"2021-02-13 17:08:56.951266414Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ie2Iy01UbzbWz5vfABk9fUl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.957106_82.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:08:56.957106108Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FjsXvYcvMg190djv14ASo-P","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.973626_83.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:08:56.973626594Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FjsXvYcvMg190djv14ASo-P","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.631677_84.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.7","timestamp":"2021-02-13 17:09:02.631677351Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.647548_85.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.7","timestamp":"2021-02-13 17:09:02.647548032Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.653493_86.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:02.653493574Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lrvu-9J8P0Qz9rirKPuLeSg","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.664789_87.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:02.664789113Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lrvu-9J8P0Qz9rirKPuLeSg","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236142.674711_88.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.7","timestamp":"2021-02-13 17:09:02.674711599Z","data":{"read_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":1},"write_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236142.689989_89.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.7","timestamp":"2021-02-13 17:09:02.689989837Z","data":{"read_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":1},"write_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236142.716861_90.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.8","timestamp":"2021-02-13 17:09:02.716861437Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.733587_91.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.8","timestamp":"2021-02-13 17:09:02.733587245Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.739866_92.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:02.739866856Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fEtN4yrcqZzdlH7Obu_wLl8","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.750685_93.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:02.750685926Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fEtN4yrcqZzdlH7Obu_wLl8","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236142.761155_94.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.8","timestamp":"2021-02-13 17:09:02.761155199Z","data":{"read_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":1},"write_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236142.775386_95.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.8","timestamp":"2021-02-13 17:09:02.775386218Z","data":{"read_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":1},"write_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236142.794617_96.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.9","timestamp":"2021-02-13 17:09:02.794617617Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.805719_97.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.9","timestamp":"2021-02-13 17:09:02.805719376Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.810241_98.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:02.810241733Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BbyFGtWq3GDAk_CBCFBVpbK","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.818865_99.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:02.818865566Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BbyFGtWq3GDAk_CBCFBVpbK","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236142.827228_100.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.9","timestamp":"2021-02-13 17:09:02.827228530Z","data":{"read_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":1},"write_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236142.838159_101.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.9","timestamp":"2021-02-13 17:09:02.838159819Z","data":{"read_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":1},"write_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236142.862019_102.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.10","timestamp":"2021-02-13 17:09:02.862019577Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.872078_103.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.10","timestamp":"2021-02-13 17:09:02.872078859Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.875943_104.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:02.875943276Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5Qw8xrxcL9PbNpxRqGzgs-x","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.883891_105.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:02.883891746Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5Qw8xrxcL9PbNpxRqGzgs-x","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236142.891075_106.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.10","timestamp":"2021-02-13 17:09:02.891075869Z","data":{"read_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":1},"write_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236142.901752_107.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.10","timestamp":"2021-02-13 17:09:02.901752455Z","data":{"read_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":1},"write_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236142.959830_108.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.11","timestamp":"2021-02-13 17:09:02.959830129Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.975302_109.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.11","timestamp":"2021-02-13 17:09:02.975302404Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.980644_110.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:02.980644518Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZBgeeoKpk_cVxf28vkNxXEh","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.991050_111.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:02.991050845Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZBgeeoKpk_cVxf28vkNxXEh","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236143.000310_112.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.11","timestamp":"2021-02-13 17:09:03.000310684Z","data":{"read_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":1},"write_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236143.015207_113.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.11","timestamp":"2021-02-13 17:09:03.015207766Z","data":{"read_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":1},"write_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236143.077484_114.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.12","timestamp":"2021-02-13 17:09:03.077484714Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.093641_115.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.12","timestamp":"2021-02-13 17:09:03.093641018Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236143.099932_116.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:03.099932950Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7n3rrkZ1z6GUeQYwqdZWlQc","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.111225_117.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:03.111225751Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7n3rrkZ1z6GUeQYwqdZWlQc","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236143.121091_118.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.12","timestamp":"2021-02-13 17:09:03.121091705Z","data":{"read_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":1},"write_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236143.136215_119.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.12","timestamp":"2021-02-13 17:09:03.136215200Z","data":{"read_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":1},"write_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236143.240544_120.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.13","timestamp":"2021-02-13 17:09:03.240544868Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.256062_121.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.13","timestamp":"2021-02-13 17:09:03.256062169Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236143.261970_122.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:03.261970913Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_c4p9j46Ekxm24ng54KkYX5V","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.273238_123.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:03.273238024Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_c4p9j46Ekxm24ng54KkYX5V","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236143.283107_124.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.13","timestamp":"2021-02-13 17:09:03.283107093Z","data":{"read_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":1},"write_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236143.298002_125.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.13","timestamp":"2021-02-13 17:09:03.298002217Z","data":{"read_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":1},"write_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236143.359814_126.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.14","timestamp":"2021-02-13 17:09:03.359814410Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.375221_127.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.14","timestamp":"2021-02-13 17:09:03.375221646Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236143.381038_128.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:03.381038078Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XvI88UZ1iLAh3aib-aaO9UX","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.391506_129.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:03.391506444Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XvI88UZ1iLAh3aib-aaO9UX","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236143.401486_130.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.14","timestamp":"2021-02-13 17:09:03.401486198Z","data":{"read_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":1},"write_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236143.416837_131.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.14","timestamp":"2021-02-13 17:09:03.416837625Z","data":{"read_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":1},"write_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236143.517883_132.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.15","timestamp":"2021-02-13 17:09:03.517883464Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.533432_133.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.15","timestamp":"2021-02-13 17:09:03.533432357Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236143.539825_134.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:03.539825925Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-z0jqf_7EggFfDdVF7UgGvE","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.551491_135.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:03.551491057Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-z0jqf_7EggFfDdVF7UgGvE","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236143.561428_136.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.15","timestamp":"2021-02-13 17:09:03.561428385Z","data":{"read_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":1},"write_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236143.577282_137.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.15","timestamp":"2021-02-13 17:09:03.577282401Z","data":{"read_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":1},"write_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236159.521655_138.1","section":"bucket.instance","name":"fggivf-7:828f8250-b337-4094-a551-9a6ba396e2f7.4334.16","timestamp":"2021-02-13 17:09:19.521655971Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Novyg1ni_NVvq7E3Sxcuc9j","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.538369_139.1","section":"bucket.instance","name":"fggivf-7:828f8250-b337-4094-a551-9a6ba396e2f7.4334.16","timestamp":"2021-02-13 17:09:19.538369977Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Novyg1ni_NVvq7E3Sxcuc9j","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236159.545091_140.1","section":"bucket","name":"fggivf-7","timestamp":"2021-02-13 17:09:19.545091698Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.562813_141.1","section":"bucket","name":"fggivf-7","timestamp":"2021-02-13 17:09:19.562813463Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236159.592942_142.1","section":"bucket.instance","name":"fggivf-8:828f8250-b337-4094-a551-9a6ba396e2f7.4334.17","timestamp":"2021-02-13 17:09:19.592942571Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rS5HrgXvvd0g20Kc9nZDh57","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.609255_143.1","section":"bucket.instance","name":"fggivf-8:828f8250-b337-4094-a551-9a6ba396e2f7.4334.17","timestamp":"2021-02-13 17:09:19.609255746Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rS5HrgXvvd0g20Kc9nZDh57","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236159.614994_144.1","section":"bucket","name":"fggivf-8","timestamp":"2021-02-13 17:09:19.614994093Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.630344_145.1","section":"bucket","name":"fggivf-8","timestamp":"2021-02-13 17:09:19.630344839Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236159.692632_146.1","section":"bucket.instance","name":"fggivf-9:828f8250-b337-4094-a551-9a6ba396e2f7.4334.18","timestamp":"2021-02-13 17:09:19.692632205Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3Cb1enbvLKK1av5fFEjGanj","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.708401_147.1","section":"bucket.instance","name":"fggivf-9:828f8250-b337-4094-a551-9a6ba396e2f7.4334.18","timestamp":"2021-02-13 17:09:19.708401977Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3Cb1enbvLKK1av5fFEjGanj","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236159.714476_148.1","section":"bucket","name":"fggivf-9","timestamp":"2021-02-13 17:09:19.714476498Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.729777_149.1","section":"bucket","name":"fggivf-9","timestamp":"2021-02-13 17:09:19.729777247Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236165.416017_150.1","section":"bucket","name":"fggivf-7","timestamp":"2021-02-13 17:09:25.416017261Z","data":{"read_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":1},"write_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236165.431937_151.1","section":"bucket","name":"fggivf-7","timestamp":"2021-02-13 17:09:25.431937039Z","data":{"read_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":1},"write_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236165.469186_152.1","section":"bucket","name":"fggivf-8","timestamp":"2021-02-13 17:09:25.469186740Z","data":{"read_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":1},"write_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236165.484451_153.1","section":"bucket","name":"fggivf-8","timestamp":"2021-02-13 17:09:25.484451837Z","data":{"read_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":1},"write_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236165.555023_154.1","section":"bucket","name":"fggivf-9","timestamp":"2021-02-13 17:09:25.555023108Z","data":{"read_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":1},"write_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236165.569853_155.1","section":"bucket","name":"fggivf-9","timestamp":"2021-02-13 17:09:25.569853904Z","data":{"read_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":1},"write_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":2},"status":{"status":"complete"}}}] 2021-02-13T17:49:45.716 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'efc2d01e-ebf2-4522-b313-ef15a0018fb0', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:45.716 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'efc2d01e-ebf2-4522-b313-ef15a0018fb0', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:45.716 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period efc2d01e-ebf2-4522-b313-ef15a0018fb0 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:45.800 INFO:teuthology.orchestra.run.gibba038.stdout:[{"id":"1_1613236014.099941_62.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-02-13 17:06:54.099941197Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-EqbQ-5-T-VOn7NS4I-3wpD","ver":1},"status":{"status":"write"}}},{"id":"1_1613236014.104172_63.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-02-13 17:06:54.104172306Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-EqbQ-5-T-VOn7NS4I-3wpD","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.196438_53.1","section":"bucket.instance","name":"fggivf-10:828f8250-b337-4094-a551-9a6ba396e2f7.4334.19","timestamp":"2021-02-13 17:09:31.196438735Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VqIo9kuwkG0XTnFoSK7eyK-","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.212307_54.1","section":"bucket.instance","name":"fggivf-10:828f8250-b337-4094-a551-9a6ba396e2f7.4334.19","timestamp":"2021-02-13 17:09:31.212307438Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VqIo9kuwkG0XTnFoSK7eyK-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.217988_55.1","section":"bucket","name":"fggivf-10","timestamp":"2021-02-13 17:09:31.217988294Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nxPcI_eGiafcaXWPcfqb5Vk","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.234221_56.1","section":"bucket","name":"fggivf-10","timestamp":"2021-02-13 17:09:31.234221933Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nxPcI_eGiafcaXWPcfqb5Vk","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.263723_57.1","section":"bucket.instance","name":"fggivf-11:828f8250-b337-4094-a551-9a6ba396e2f7.4334.20","timestamp":"2021-02-13 17:09:31.263723814Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bHDXjSYpcZqa8cF13iKmv-Z","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.280955_58.1","section":"bucket.instance","name":"fggivf-11:828f8250-b337-4094-a551-9a6ba396e2f7.4334.20","timestamp":"2021-02-13 17:09:31.280955898Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bHDXjSYpcZqa8cF13iKmv-Z","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.286667_59.1","section":"bucket","name":"fggivf-11","timestamp":"2021-02-13 17:09:31.286667194Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Et04VXAHGO2T4lGwRveYoQ1","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.302019_60.1","section":"bucket","name":"fggivf-11","timestamp":"2021-02-13 17:09:31.302019141Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Et04VXAHGO2T4lGwRveYoQ1","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.364279_61.1","section":"bucket.instance","name":"fggivf-12:828f8250-b337-4094-a551-9a6ba396e2f7.4334.21","timestamp":"2021-02-13 17:09:31.364279946Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oseyFAJlhQNqzgInpGtp0TD","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.380702_62.1","section":"bucket.instance","name":"fggivf-12:828f8250-b337-4094-a551-9a6ba396e2f7.4334.21","timestamp":"2021-02-13 17:09:31.380702382Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oseyFAJlhQNqzgInpGtp0TD","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236171.386265_63.1","section":"bucket","name":"fggivf-12","timestamp":"2021-02-13 17:09:31.386265156Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WbAeBcLswvqM1wd_YAUaTIh","ver":1},"status":{"status":"write"}}},{"id":"1_1613236171.401277_64.1","section":"bucket","name":"fggivf-12","timestamp":"2021-02-13 17:09:31.401277752Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WbAeBcLswvqM1wd_YAUaTIh","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.685309_71.1","section":"bucket.instance","name":"fggivf-13:828f8250-b337-4094-a551-9a6ba396e2f7.4334.22","timestamp":"2021-02-13 17:14:54.685309265Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bet3NdQXYKvr67yifwstqHa","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.701763_72.1","section":"bucket.instance","name":"fggivf-13:828f8250-b337-4094-a551-9a6ba396e2f7.4334.22","timestamp":"2021-02-13 17:14:54.701763932Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bet3NdQXYKvr67yifwstqHa","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.707087_73.1","section":"bucket","name":"fggivf-13","timestamp":"2021-02-13 17:14:54.707087471Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_B3O8SPnFCECzDcoGwLitIc4","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.722191_74.1","section":"bucket","name":"fggivf-13","timestamp":"2021-02-13 17:14:54.722191389Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_B3O8SPnFCECzDcoGwLitIc4","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.756933_75.1","section":"bucket.instance","name":"fggivf-14:828f8250-b337-4094-a551-9a6ba396e2f7.4334.23","timestamp":"2021-02-13 17:14:54.756933058Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bSUE5kl9CAXtByR8WRHpzt1","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.772874_76.1","section":"bucket.instance","name":"fggivf-14:828f8250-b337-4094-a551-9a6ba396e2f7.4334.23","timestamp":"2021-02-13 17:14:54.772874859Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bSUE5kl9CAXtByR8WRHpzt1","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.778694_77.1","section":"bucket","name":"fggivf-14","timestamp":"2021-02-13 17:14:54.778694733Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RklCZ_OXWLx7fnH2DF-eHxz","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.794815_78.1","section":"bucket","name":"fggivf-14","timestamp":"2021-02-13 17:14:54.794815276Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RklCZ_OXWLx7fnH2DF-eHxz","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.859459_79.1","section":"bucket.instance","name":"fggivf-15:828f8250-b337-4094-a551-9a6ba396e2f7.4334.24","timestamp":"2021-02-13 17:14:54.859459452Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Siw_0gtpVKdXR543NrVsJzq","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.875105_80.1","section":"bucket.instance","name":"fggivf-15:828f8250-b337-4094-a551-9a6ba396e2f7.4334.24","timestamp":"2021-02-13 17:14:54.875105442Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Siw_0gtpVKdXR543NrVsJzq","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236494.881339_81.1","section":"bucket","name":"fggivf-15","timestamp":"2021-02-13 17:14:54.881339509Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wfRCCKCutoHS32Z_LKOhZ-_","ver":1},"status":{"status":"write"}}},{"id":"1_1613236494.899000_82.1","section":"bucket","name":"fggivf-15","timestamp":"2021-02-13 17:14:54.899000450Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wfRCCKCutoHS32Z_LKOhZ-_","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.351934_98.1","section":"bucket.instance","name":"fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","timestamp":"2021-02-13 17:20:14.351934045Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.367986_99.1","section":"bucket.instance","name":"fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","timestamp":"2021-02-13 17:20:14.367986747Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.373839_100.1","section":"bucket","name":"fggivf-16","timestamp":"2021-02-13 17:20:14.373839766Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Wgs25dS8grYhXa5RLNPolFM","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.389049_101.1","section":"bucket","name":"fggivf-16","timestamp":"2021-02-13 17:20:14.389049062Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Wgs25dS8grYhXa5RLNPolFM","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.452556_102.1","section":"bucket.instance","name":"fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","timestamp":"2021-02-13 17:20:14.452556828Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.467356_103.1","section":"bucket.instance","name":"fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","timestamp":"2021-02-13 17:20:14.467356976Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.473165_104.1","section":"bucket","name":"fggivf-17","timestamp":"2021-02-13 17:20:14.473165220Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WK43gg7njPFFdyncspZKr6N","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.488426_105.1","section":"bucket","name":"fggivf-17","timestamp":"2021-02-13 17:20:14.488426065Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WK43gg7njPFFdyncspZKr6N","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.557187_106.1","section":"bucket.instance","name":"fggivf-18:828f8250-b337-4094-a551-9a6ba396e2f7.4334.27","timestamp":"2021-02-13 17:20:14.557187293Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.572460_107.1","section":"bucket.instance","name":"fggivf-18:828f8250-b337-4094-a551-9a6ba396e2f7.4334.27","timestamp":"2021-02-13 17:20:14.572460177Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.577949_108.1","section":"bucket","name":"fggivf-18","timestamp":"2021-02-13 17:20:14.577949325Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2LHX0c0R1XPMZ0M8-TFhz44","ver":1},"status":{"status":"write"}}},{"id":"1_1613236814.592532_109.1","section":"bucket","name":"fggivf-18","timestamp":"2021-02-13 17:20:14.592532320Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2LHX0c0R1XPMZ0M8-TFhz44","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236814.639959_110.1","section":"bucket.instance","name":"fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","timestamp":"2021-02-13 17:20:14.639959058Z","data":{"read_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":1},"write_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":2},"status":{"status":"write"}}},{"id":"1_1613236814.655562_111.1","section":"bucket.instance","name":"fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","timestamp":"2021-02-13 17:20:14.655562406Z","data":{"read_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":1},"write_version":{"tag":"_kgTD230uZdhSy6NXwQ083Tm","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236814.665189_112.1","section":"bucket.instance","name":"fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","timestamp":"2021-02-13 17:20:14.665189301Z","data":{"read_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":1},"write_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":2},"status":{"status":"write"}}},{"id":"1_1613236814.681183_113.1","section":"bucket.instance","name":"fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","timestamp":"2021-02-13 17:20:14.681183928Z","data":{"read_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":1},"write_version":{"tag":"_4vs86fsAaTEjE1ZeV3OpsuS","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236814.701746_114.1","section":"bucket.instance","name":"fggivf-18:828f8250-b337-4094-a551-9a6ba396e2f7.4334.27","timestamp":"2021-02-13 17:20:14.701746389Z","data":{"read_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":1},"write_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":2},"status":{"status":"write"}}},{"id":"1_1613236814.717897_115.1","section":"bucket.instance","name":"fggivf-18:828f8250-b337-4094-a551-9a6ba396e2f7.4334.27","timestamp":"2021-02-13 17:20:14.717897308Z","data":{"read_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":1},"write_version":{"tag":"_zZ1rIpLyar_5xBFPl_-0SMK","ver":2},"status":{"status":"complete"}}},{"id":"1_1613237142.622184_121.1","section":"bucket.instance","name":"fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","timestamp":"2021-02-13 17:25:42.622184525Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":1},"status":{"status":"write"}}},{"id":"1_1613237142.637550_122.1","section":"bucket.instance","name":"fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","timestamp":"2021-02-13 17:25:42.637550077Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237142.643141_123.1","section":"bucket","name":"fggivf-19","timestamp":"2021-02-13 17:25:42.643141946Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vNd2GKIsAUed0Y8dIy7JYVk","ver":1},"status":{"status":"write"}}},{"id":"1_1613237142.659069_124.1","section":"bucket","name":"fggivf-19","timestamp":"2021-02-13 17:25:42.659069522Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vNd2GKIsAUed0Y8dIy7JYVk","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237142.676967_125.1","section":"bucket.instance","name":"fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","timestamp":"2021-02-13 17:25:42.676967515Z","data":{"read_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":1},"write_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":2},"status":{"status":"write"}}},{"id":"1_1613237142.691994_126.1","section":"bucket.instance","name":"fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","timestamp":"2021-02-13 17:25:42.691994132Z","data":{"read_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":1},"write_version":{"tag":"_Bi0zuY_AG0y5yk0ZTQMecHf","ver":2},"status":{"status":"complete"}}},{"id":"1_1613237465.669610_143.1","section":"bucket.instance","name":"fggivf-20:828f8250-b337-4094-a551-9a6ba396e2f7.4334.29","timestamp":"2021-02-13 17:31:05.669610151Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iAu6k8sFyJ8ucyuC09n-JOP","ver":1},"status":{"status":"write"}}},{"id":"1_1613237465.684813_144.1","section":"bucket.instance","name":"fggivf-20:828f8250-b337-4094-a551-9a6ba396e2f7.4334.29","timestamp":"2021-02-13 17:31:05.684813775Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iAu6k8sFyJ8ucyuC09n-JOP","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237465.690336_145.1","section":"bucket","name":"fggivf-20","timestamp":"2021-02-13 17:31:05.690336750Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kvL_VY8rpUJDn8f_Pwd8jyv","ver":1},"status":{"status":"write"}}},{"id":"1_1613237465.705456_146.1","section":"bucket","name":"fggivf-20","timestamp":"2021-02-13 17:31:05.705456444Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kvL_VY8rpUJDn8f_Pwd8jyv","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.761810_152.1","section":"bucket.instance","name":"fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","timestamp":"2021-02-13 17:36:28.761810479Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.776807_153.1","section":"bucket.instance","name":"fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","timestamp":"2021-02-13 17:36:28.776807744Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.782089_154.1","section":"bucket","name":"fggivf-21","timestamp":"2021-02-13 17:36:28.782089078Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SAq4BYH3EwV0UU61VP1pejU","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.796754_155.1","section":"bucket","name":"fggivf-21","timestamp":"2021-02-13 17:36:28.796754434Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SAq4BYH3EwV0UU61VP1pejU","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.838589_156.1","section":"bucket.instance","name":"fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","timestamp":"2021-02-13 17:36:28.838589398Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.853961_157.1","section":"bucket.instance","name":"fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","timestamp":"2021-02-13 17:36:28.853961735Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.859505_158.1","section":"bucket","name":"fggivf-22","timestamp":"2021-02-13 17:36:28.859505636Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eCxNTRRU6vroIYjjBDnY5XZ","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.874384_159.1","section":"bucket","name":"fggivf-22","timestamp":"2021-02-13 17:36:28.874384442Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eCxNTRRU6vroIYjjBDnY5XZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.945045_160.1","section":"bucket.instance","name":"fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","timestamp":"2021-02-13 17:36:28.945045451Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.960629_161.1","section":"bucket.instance","name":"fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","timestamp":"2021-02-13 17:36:28.960629424Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237788.966694_162.1","section":"bucket","name":"fggivf-23","timestamp":"2021-02-13 17:36:28.966694385Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DSTm1o5MsVn7oaPFz55_QQo","ver":1},"status":{"status":"write"}}},{"id":"1_1613237788.980647_163.1","section":"bucket","name":"fggivf-23","timestamp":"2021-02-13 17:36:28.980647568Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DSTm1o5MsVn7oaPFz55_QQo","ver":1},"status":{"status":"complete"}}},{"id":"1_1613237789.025752_164.1","section":"bucket.instance","name":"fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","timestamp":"2021-02-13 17:36:29.025752790Z","data":{"read_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":1},"write_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":2},"status":{"status":"write"}}},{"id":"1_1613237789.040157_165.1","section":"bucket.instance","name":"fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","timestamp":"2021-02-13 17:36:29.040157273Z","data":{"read_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":1},"write_version":{"tag":"_Y_ILPt1mu0Yj4UXGuEekswT","ver":2},"status":{"status":"complete"}}},{"id":"1_1613237789.053244_166.1","section":"bucket.instance","name":"fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","timestamp":"2021-02-13 17:36:29.053244209Z","data":{"read_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":1},"write_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":2},"status":{"status":"write"}}},{"id":"1_1613237789.068914_167.1","section":"bucket.instance","name":"fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","timestamp":"2021-02-13 17:36:29.068914555Z","data":{"read_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":1},"write_version":{"tag":"_4bltStZoCl53H9yXlx4rTX0","ver":2},"status":{"status":"complete"}}},{"id":"1_1613237789.092382_168.1","section":"bucket.instance","name":"fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","timestamp":"2021-02-13 17:36:29.092382493Z","data":{"read_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":1},"write_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":2},"status":{"status":"write"}}},{"id":"1_1613237789.107690_169.1","section":"bucket.instance","name":"fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","timestamp":"2021-02-13 17:36:29.107690528Z","data":{"read_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":1},"write_version":{"tag":"_NAM2N7pD0yF-t80VbqdKi-n","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238112.432178_186.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.432178658Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.447711_187.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.447711839Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.453484_188.1","section":"bucket","name":"fggivf-24","timestamp":"2021-02-13 17:41:52.453484095Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GQBIz3Bmn45tGg3QZpgBzLl","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.468700_189.1","section":"bucket","name":"fggivf-24","timestamp":"2021-02-13 17:41:52.468700608Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GQBIz3Bmn45tGg3QZpgBzLl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.502635_190.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.502635621Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.517751_191.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.517751746Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.523727_192.1","section":"bucket","name":"fggivf-25","timestamp":"2021-02-13 17:41:52.523727660Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9QZ2f9ENO66rg0kQaL0rCKO","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.538746_193.1","section":"bucket","name":"fggivf-25","timestamp":"2021-02-13 17:41:52.538746514Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9QZ2f9ENO66rg0kQaL0rCKO","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.603353_194.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.603353685Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.619142_195.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.619142346Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.625305_196.1","section":"bucket","name":"fggivf-26","timestamp":"2021-02-13 17:41:52.625305155Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fWUBwfHqYL3oqMcQx9P7R8A","ver":1},"status":{"status":"write"}}},{"id":"1_1613238112.640724_197.1","section":"bucket","name":"fggivf-26","timestamp":"2021-02-13 17:41:52.640724565Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fWUBwfHqYL3oqMcQx9P7R8A","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238112.693308_198.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.693308506Z","data":{"read_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":1},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":2},"status":{"status":"write"}}},{"id":"1_1613238112.708606_199.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.708606961Z","data":{"read_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":1},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238112.718551_200.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.718551598Z","data":{"read_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":2},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":3},"status":{"status":"write"}}},{"id":"1_1613238112.733710_201.1","section":"bucket.instance","name":"fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","timestamp":"2021-02-13 17:41:52.733710194Z","data":{"read_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":2},"write_version":{"tag":"_hfK_M7mPADYo3NjNCKtYdwN","ver":3},"status":{"status":"complete"}}},{"id":"1_1613238112.747048_202.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.747048544Z","data":{"read_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":1},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":2},"status":{"status":"write"}}},{"id":"1_1613238112.762327_203.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.762327000Z","data":{"read_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":1},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238112.791260_204.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.791260146Z","data":{"read_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":2},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":3},"status":{"status":"write"}}},{"id":"1_1613238112.807174_205.1","section":"bucket.instance","name":"fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","timestamp":"2021-02-13 17:41:52.807174414Z","data":{"read_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":2},"write_version":{"tag":"_TxaiUG4zVH_jF61ZfdWCUIK","ver":3},"status":{"status":"complete"}}},{"id":"1_1613238112.831806_206.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.831806374Z","data":{"read_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":1},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":2},"status":{"status":"write"}}},{"id":"1_1613238112.847291_207.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.847291901Z","data":{"read_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":1},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238112.871196_208.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.871196235Z","data":{"read_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":2},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":3},"status":{"status":"write"}}},{"id":"1_1613238112.886659_209.1","section":"bucket.instance","name":"fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","timestamp":"2021-02-13 17:41:52.886659003Z","data":{"read_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":2},"write_version":{"tag":"_iZn3WvfOSic1kdLF_uv0PpB","ver":3},"status":{"status":"complete"}}},{"id":"1_1613238431.110994_232.1","section":"bucket.instance","name":"fggivf-27:828f8250-b337-4094-a551-9a6ba396e2f7.4334.36","timestamp":"2021-02-13 17:47:11.110994447Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.126328_233.1","section":"bucket.instance","name":"fggivf-27:828f8250-b337-4094-a551-9a6ba396e2f7.4334.36","timestamp":"2021-02-13 17:47:11.126328287Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.131489_234.1","section":"bucket","name":"fggivf-27","timestamp":"2021-02-13 17:47:11.131489568Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6Cy8XaR4r9WYhv_ztFn-mpf","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.146258_235.1","section":"bucket","name":"fggivf-27","timestamp":"2021-02-13 17:47:11.146258185Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6Cy8XaR4r9WYhv_ztFn-mpf","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.177639_236.1","section":"bucket.instance","name":"fggivf-28:828f8250-b337-4094-a551-9a6ba396e2f7.4334.37","timestamp":"2021-02-13 17:47:11.177639803Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.192729_237.1","section":"bucket.instance","name":"fggivf-28:828f8250-b337-4094-a551-9a6ba396e2f7.4334.37","timestamp":"2021-02-13 17:47:11.192729594Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.198158_238.1","section":"bucket","name":"fggivf-28","timestamp":"2021-02-13 17:47:11.198158261Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PA91Z3oPFW8M03bxnilmzO5","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.213216_239.1","section":"bucket","name":"fggivf-28","timestamp":"2021-02-13 17:47:11.213216863Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PA91Z3oPFW8M03bxnilmzO5","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.275134_240.1","section":"bucket.instance","name":"fggivf-29:828f8250-b337-4094-a551-9a6ba396e2f7.4334.38","timestamp":"2021-02-13 17:47:11.275134983Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.291290_241.1","section":"bucket.instance","name":"fggivf-29:828f8250-b337-4094-a551-9a6ba396e2f7.4334.38","timestamp":"2021-02-13 17:47:11.291290727Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.297391_242.1","section":"bucket","name":"fggivf-29","timestamp":"2021-02-13 17:47:11.297391016Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hkei1McsRKCT8pKcR36qyoK","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.313623_243.1","section":"bucket","name":"fggivf-29","timestamp":"2021-02-13 17:47:11.313623171Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hkei1McsRKCT8pKcR36qyoK","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.357873_244.1","section":"bucket.instance","name":"fggivf-27:828f8250-b337-4094-a551-9a6ba396e2f7.4334.36","timestamp":"2021-02-13 17:47:11.357873884Z","data":{"read_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":1},"write_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":2},"status":{"status":"write"}}},{"id":"1_1613238431.373561_245.1","section":"bucket.instance","name":"fggivf-27:828f8250-b337-4094-a551-9a6ba396e2f7.4334.36","timestamp":"2021-02-13 17:47:11.373561834Z","data":{"read_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":1},"write_version":{"tag":"_J-66GwOA-e682KqtOQJgUTQ","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238431.431448_246.1","section":"bucket.instance","name":"fggivf-28:828f8250-b337-4094-a551-9a6ba396e2f7.4334.37","timestamp":"2021-02-13 17:47:11.431448394Z","data":{"read_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":1},"write_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":2},"status":{"status":"write"}}},{"id":"1_1613238431.448264_247.1","section":"bucket.instance","name":"fggivf-28:828f8250-b337-4094-a551-9a6ba396e2f7.4334.37","timestamp":"2021-02-13 17:47:11.448264002Z","data":{"read_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":1},"write_version":{"tag":"_Yt7IWdb4DufTINhnpaGoHhz","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238431.514051_248.1","section":"bucket.instance","name":"fggivf-29:828f8250-b337-4094-a551-9a6ba396e2f7.4334.38","timestamp":"2021-02-13 17:47:11.514051259Z","data":{"read_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":1},"write_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":2},"status":{"status":"write"}}},{"id":"1_1613238431.529019_249.1","section":"bucket.instance","name":"fggivf-29:828f8250-b337-4094-a551-9a6ba396e2f7.4334.38","timestamp":"2021-02-13 17:47:11.529019779Z","data":{"read_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":1},"write_version":{"tag":"_zfHyiQL1RTea1ClkwKbTcVU","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238431.604115_250.1","section":"bucket.instance","name":"fggivf-30:828f8250-b337-4094-a551-9a6ba396e2f7.4334.39","timestamp":"2021-02-13 17:47:11.604115910Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.620570_251.1","section":"bucket.instance","name":"fggivf-30:828f8250-b337-4094-a551-9a6ba396e2f7.4334.39","timestamp":"2021-02-13 17:47:11.620570555Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.626060_252.1","section":"bucket","name":"fggivf-30","timestamp":"2021-02-13 17:47:11.626060648Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iZD09tXPcC9vaV2z68fQzCF","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.641220_253.1","section":"bucket","name":"fggivf-30","timestamp":"2021-02-13 17:47:11.641220907Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iZD09tXPcC9vaV2z68fQzCF","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.670263_254.1","section":"bucket.instance","name":"fggivf-31:828f8250-b337-4094-a551-9a6ba396e2f7.4334.40","timestamp":"2021-02-13 17:47:11.670263825Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.685325_255.1","section":"bucket.instance","name":"fggivf-31:828f8250-b337-4094-a551-9a6ba396e2f7.4334.40","timestamp":"2021-02-13 17:47:11.685325015Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.691225_256.1","section":"bucket","name":"fggivf-31","timestamp":"2021-02-13 17:47:11.691225792Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GPZ6dExScYRc4voXrZgR_-d","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.706046_257.1","section":"bucket","name":"fggivf-31","timestamp":"2021-02-13 17:47:11.706046764Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GPZ6dExScYRc4voXrZgR_-d","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.769586_258.1","section":"bucket.instance","name":"fggivf-32:828f8250-b337-4094-a551-9a6ba396e2f7.4334.41","timestamp":"2021-02-13 17:47:11.769586952Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.786167_259.1","section":"bucket.instance","name":"fggivf-32:828f8250-b337-4094-a551-9a6ba396e2f7.4334.41","timestamp":"2021-02-13 17:47:11.786167576Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.792407_260.1","section":"bucket","name":"fggivf-32","timestamp":"2021-02-13 17:47:11.792407276Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BMNwg0clYxO4nk3eV73Facz","ver":1},"status":{"status":"write"}}},{"id":"1_1613238431.807305_261.1","section":"bucket","name":"fggivf-32","timestamp":"2021-02-13 17:47:11.807305878Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BMNwg0clYxO4nk3eV73Facz","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238431.854693_262.1","section":"bucket.instance","name":"fggivf-30:828f8250-b337-4094-a551-9a6ba396e2f7.4334.39","timestamp":"2021-02-13 17:47:11.854693585Z","data":{"read_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":1},"write_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":2},"status":{"status":"write"}}},{"id":"1_1613238431.869998_263.1","section":"bucket.instance","name":"fggivf-30:828f8250-b337-4094-a551-9a6ba396e2f7.4334.39","timestamp":"2021-02-13 17:47:11.869998434Z","data":{"read_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":1},"write_version":{"tag":"_jgvZrAIc7OsGfSkY4xyEycO","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238431.924481_264.1","section":"bucket.instance","name":"fggivf-31:828f8250-b337-4094-a551-9a6ba396e2f7.4334.40","timestamp":"2021-02-13 17:47:11.924481477Z","data":{"read_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":1},"write_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":2},"status":{"status":"write"}}},{"id":"1_1613238431.939618_265.1","section":"bucket.instance","name":"fggivf-31:828f8250-b337-4094-a551-9a6ba396e2f7.4334.40","timestamp":"2021-02-13 17:47:11.939618544Z","data":{"read_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":1},"write_version":{"tag":"_T1Yv4kxEUoMK9IaC-rezgVu","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238432.012666_266.1","section":"bucket.instance","name":"fggivf-32:828f8250-b337-4094-a551-9a6ba396e2f7.4334.41","timestamp":"2021-02-13 17:47:12.012666100Z","data":{"read_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":1},"write_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":2},"status":{"status":"write"}}},{"id":"1_1613238432.029467_267.1","section":"bucket.instance","name":"fggivf-32:828f8250-b337-4094-a551-9a6ba396e2f7.4334.41","timestamp":"2021-02-13 17:47:12.029467966Z","data":{"read_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":1},"write_version":{"tag":"_NlS19y180308y_e7u_dCNru","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238432.104055_268.1","section":"bucket.instance","name":"fggivf-33:828f8250-b337-4094-a551-9a6ba396e2f7.4334.42","timestamp":"2021-02-13 17:47:12.104055309Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.119795_269.1","section":"bucket.instance","name":"fggivf-33:828f8250-b337-4094-a551-9a6ba396e2f7.4334.42","timestamp":"2021-02-13 17:47:12.119795519Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.125075_270.1","section":"bucket","name":"fggivf-33","timestamp":"2021-02-13 17:47:12.125075320Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_gw_ofPwNHQ1fSnVedLiAcTj","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.139354_271.1","section":"bucket","name":"fggivf-33","timestamp":"2021-02-13 17:47:12.139354982Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_gw_ofPwNHQ1fSnVedLiAcTj","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.168601_272.1","section":"bucket.instance","name":"fggivf-34:828f8250-b337-4094-a551-9a6ba396e2f7.4334.43","timestamp":"2021-02-13 17:47:12.168601856Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.184386_273.1","section":"bucket.instance","name":"fggivf-34:828f8250-b337-4094-a551-9a6ba396e2f7.4334.43","timestamp":"2021-02-13 17:47:12.184386478Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.190106_274.1","section":"bucket","name":"fggivf-34","timestamp":"2021-02-13 17:47:12.190106317Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_aaLW-3YhFzLY9wSTlsDn6tM","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.205963_275.1","section":"bucket","name":"fggivf-34","timestamp":"2021-02-13 17:47:12.205963360Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_aaLW-3YhFzLY9wSTlsDn6tM","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.248026_276.1","section":"bucket.instance","name":"fggivf-35:828f8250-b337-4094-a551-9a6ba396e2f7.4334.44","timestamp":"2021-02-13 17:47:12.248026075Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.253923_277.1","section":"bucket.instance","name":"fggivf-35:828f8250-b337-4094-a551-9a6ba396e2f7.4334.44","timestamp":"2021-02-13 17:47:12.253923030Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.255524_278.1","section":"bucket","name":"fggivf-35","timestamp":"2021-02-13 17:47:12.255524489Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rojmW78rwGJU-nwoki0xa0F","ver":1},"status":{"status":"write"}}},{"id":"1_1613238432.259703_279.1","section":"bucket","name":"fggivf-35","timestamp":"2021-02-13 17:47:12.259703553Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rojmW78rwGJU-nwoki0xa0F","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238432.271275_280.1","section":"bucket.instance","name":"fggivf-33:828f8250-b337-4094-a551-9a6ba396e2f7.4334.42","timestamp":"2021-02-13 17:47:12.271275645Z","data":{"read_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":1},"write_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":2},"status":{"status":"write"}}},{"id":"1_1613238432.274462_281.1","section":"bucket.instance","name":"fggivf-33:828f8250-b337-4094-a551-9a6ba396e2f7.4334.42","timestamp":"2021-02-13 17:47:12.274462102Z","data":{"read_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":1},"write_version":{"tag":"_Pqnx11qnpggfrLVSnMfhxWs","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238433.322337_282.1","section":"bucket.instance","name":"fggivf-34:828f8250-b337-4094-a551-9a6ba396e2f7.4334.43","timestamp":"2021-02-13 17:47:13.322337702Z","data":{"read_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":1},"write_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":2},"status":{"status":"write"}}},{"id":"1_1613238433.338648_283.1","section":"bucket.instance","name":"fggivf-34:828f8250-b337-4094-a551-9a6ba396e2f7.4334.43","timestamp":"2021-02-13 17:47:13.338648163Z","data":{"read_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":1},"write_version":{"tag":"_VX12-9Ip-4DoqTRMJ71HlTf","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238434.403111_284.1","section":"bucket.instance","name":"fggivf-35:828f8250-b337-4094-a551-9a6ba396e2f7.4334.44","timestamp":"2021-02-13 17:47:14.403111689Z","data":{"read_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":1},"write_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":2},"status":{"status":"write"}}},{"id":"1_1613238434.419714_285.1","section":"bucket.instance","name":"fggivf-35:828f8250-b337-4094-a551-9a6ba396e2f7.4334.44","timestamp":"2021-02-13 17:47:14.419714729Z","data":{"read_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":1},"write_version":{"tag":"_WKgsQnptOHsdQY-aObeuMbn","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238434.495955_286.1","section":"bucket.instance","name":"fggivf-36:828f8250-b337-4094-a551-9a6ba396e2f7.4334.45","timestamp":"2021-02-13 17:47:14.495955275Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oFRvoHby-NEbuPiJg1Te1nF","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.511160_287.1","section":"bucket.instance","name":"fggivf-36:828f8250-b337-4094-a551-9a6ba396e2f7.4334.45","timestamp":"2021-02-13 17:47:14.511160668Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oFRvoHby-NEbuPiJg1Te1nF","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238434.516676_288.1","section":"bucket","name":"fggivf-36","timestamp":"2021-02-13 17:47:14.516676016Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bsQF25cf8hm7Sy5HS8anb54","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.531725_289.1","section":"bucket","name":"fggivf-36","timestamp":"2021-02-13 17:47:14.531725888Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bsQF25cf8hm7Sy5HS8anb54","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238434.567713_290.1","section":"bucket.instance","name":"fggivf-37:828f8250-b337-4094-a551-9a6ba396e2f7.4334.46","timestamp":"2021-02-13 17:47:14.567713005Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2koJCBhqViBn12TfgX4YTUi","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.583305_291.1","section":"bucket.instance","name":"fggivf-37:828f8250-b337-4094-a551-9a6ba396e2f7.4334.46","timestamp":"2021-02-13 17:47:14.583305306Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2koJCBhqViBn12TfgX4YTUi","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238434.589447_292.1","section":"bucket","name":"fggivf-37","timestamp":"2021-02-13 17:47:14.589447349Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xW11GxEwkt4pAdn-VhA3qWS","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.604868_293.1","section":"bucket","name":"fggivf-37","timestamp":"2021-02-13 17:47:14.604868280Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xW11GxEwkt4pAdn-VhA3qWS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238434.650663_295.1","section":"bucket.instance","name":"fggivf-38:828f8250-b337-4094-a551-9a6ba396e2f7.4334.47","timestamp":"2021-02-13 17:47:14.650663028Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PyQEbBLGkQ7_rBTmEDUkRDC","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.666398_296.1","section":"bucket.instance","name":"fggivf-38:828f8250-b337-4094-a551-9a6ba396e2f7.4334.47","timestamp":"2021-02-13 17:47:14.666398024Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PyQEbBLGkQ7_rBTmEDUkRDC","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238434.672194_297.1","section":"bucket","name":"fggivf-38","timestamp":"2021-02-13 17:47:14.672194433Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_tjB7sDK6SUz9uQt09EnxrA-","ver":1},"status":{"status":"write"}}},{"id":"1_1613238434.687444_298.1","section":"bucket","name":"fggivf-38","timestamp":"2021-02-13 17:47:14.687444045Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_tjB7sDK6SUz9uQt09EnxrA-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.659651_300.1","section":"bucket.instance","name":"fggivf-39:828f8250-b337-4094-a551-9a6ba396e2f7.4334.48","timestamp":"2021-02-13 17:47:20.659651295Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRK0CQi4K46Bh4QGj_5s4_n","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.675138_301.1","section":"bucket.instance","name":"fggivf-39:828f8250-b337-4094-a551-9a6ba396e2f7.4334.48","timestamp":"2021-02-13 17:47:20.675138034Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRK0CQi4K46Bh4QGj_5s4_n","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.681181_302.1","section":"bucket","name":"fggivf-39","timestamp":"2021-02-13 17:47:20.681181347Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cESFBjz-87rQcSednZLukn-","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.696424_303.1","section":"bucket","name":"fggivf-39","timestamp":"2021-02-13 17:47:20.696424972Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cESFBjz-87rQcSednZLukn-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.727667_304.1","section":"bucket.instance","name":"fggivf-40:828f8250-b337-4094-a551-9a6ba396e2f7.4334.49","timestamp":"2021-02-13 17:47:20.727667170Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2qczbG02DjkZx6nFdSZxPcL","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.742714_305.1","section":"bucket.instance","name":"fggivf-40:828f8250-b337-4094-a551-9a6ba396e2f7.4334.49","timestamp":"2021-02-13 17:47:20.742714068Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2qczbG02DjkZx6nFdSZxPcL","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.748897_306.1","section":"bucket","name":"fggivf-40","timestamp":"2021-02-13 17:47:20.748897447Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TmOyP1ZOYT9s4C5LGSsa8vl","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.764655_307.1","section":"bucket","name":"fggivf-40","timestamp":"2021-02-13 17:47:20.764655264Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TmOyP1ZOYT9s4C5LGSsa8vl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.827123_308.1","section":"bucket.instance","name":"fggivf-41:828f8250-b337-4094-a551-9a6ba396e2f7.4334.50","timestamp":"2021-02-13 17:47:20.827123309Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9XnLu93FXeHDofkHecbNN4b","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.842604_309.1","section":"bucket.instance","name":"fggivf-41:828f8250-b337-4094-a551-9a6ba396e2f7.4334.50","timestamp":"2021-02-13 17:47:20.842604793Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9XnLu93FXeHDofkHecbNN4b","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238440.848608_310.1","section":"bucket","name":"fggivf-41","timestamp":"2021-02-13 17:47:20.848608585Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZHh9J55KBd7MkjO5SBk-vLh","ver":1},"status":{"status":"write"}}},{"id":"1_1613238440.864145_311.1","section":"bucket","name":"fggivf-41","timestamp":"2021-02-13 17:47:20.864145723Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZHh9J55KBd7MkjO5SBk-vLh","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236133.197550_60.1","section":"bucket.instance","name":"fggivf-1:828f8250-b337-4094-a551-9a6ba396e2f7.4334.1","timestamp":"2021-02-13 17:08:53.197550882Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iwYERTwinHDhKEpW-rqBzp8","ver":1},"status":{"status":"write"}}},{"id":"1_1613236133.200947_61.1","section":"bucket.instance","name":"fggivf-1:828f8250-b337-4094-a551-9a6ba396e2f7.4334.1","timestamp":"2021-02-13 17:08:53.200947177Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iwYERTwinHDhKEpW-rqBzp8","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236133.202478_62.1","section":"bucket","name":"fggivf-1","timestamp":"2021-02-13 17:08:53.202478220Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LPYv-FdecuYmtn9SSLy-JHZ","ver":1},"status":{"status":"write"}}},{"id":"1_1613236133.206582_63.1","section":"bucket","name":"fggivf-1","timestamp":"2021-02-13 17:08:53.206582584Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LPYv-FdecuYmtn9SSLy-JHZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236133.246153_64.1","section":"bucket.instance","name":"fggivf-2:828f8250-b337-4094-a551-9a6ba396e2f7.4334.2","timestamp":"2021-02-13 17:08:53.246153618Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_I8iLHBQpakCuCLPHXO9q2vN","ver":1},"status":{"status":"write"}}},{"id":"1_1613236133.251139_65.1","section":"bucket.instance","name":"fggivf-2:828f8250-b337-4094-a551-9a6ba396e2f7.4334.2","timestamp":"2021-02-13 17:08:53.251139941Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_I8iLHBQpakCuCLPHXO9q2vN","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236133.253212_66.1","section":"bucket","name":"fggivf-2","timestamp":"2021-02-13 17:08:53.253212610Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E92Hr2Fs_1EA1S3K3EDmI_H","ver":1},"status":{"status":"write"}}},{"id":"1_1613236133.258917_67.1","section":"bucket","name":"fggivf-2","timestamp":"2021-02-13 17:08:53.258917343Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E92Hr2Fs_1EA1S3K3EDmI_H","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236134.406749_68.1","section":"bucket.instance","name":"fggivf-3:828f8250-b337-4094-a551-9a6ba396e2f7.4334.3","timestamp":"2021-02-13 17:08:54.406749728Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9M7LinCV5mR9088T0TcClvf","ver":1},"status":{"status":"write"}}},{"id":"1_1613236134.422269_69.1","section":"bucket.instance","name":"fggivf-3:828f8250-b337-4094-a551-9a6ba396e2f7.4334.3","timestamp":"2021-02-13 17:08:54.422269785Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9M7LinCV5mR9088T0TcClvf","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236134.428721_70.1","section":"bucket","name":"fggivf-3","timestamp":"2021-02-13 17:08:54.428721503Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wk6Qojt3L3LYLYkkItAup_o","ver":1},"status":{"status":"write"}}},{"id":"1_1613236134.444689_71.1","section":"bucket","name":"fggivf-3","timestamp":"2021-02-13 17:08:54.444689615Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wk6Qojt3L3LYLYkkItAup_o","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.770049_72.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.4","timestamp":"2021-02-13 17:08:56.770049312Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WdJWtm6Et68NovSs4Mz-Njd","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.785646_73.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.4","timestamp":"2021-02-13 17:08:56.785646586Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WdJWtm6Et68NovSs4Mz-Njd","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.791980_74.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:08:56.791980224Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zDXyt_VCl0mDYK8kQXK1gB2","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.807148_75.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:08:56.807148902Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zDXyt_VCl0mDYK8kQXK1gB2","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.835479_76.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.5","timestamp":"2021-02-13 17:08:56.835479041Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZeRq4idumAd0kJI7fzA2l-t","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.851468_77.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.5","timestamp":"2021-02-13 17:08:56.851468248Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZeRq4idumAd0kJI7fzA2l-t","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.857413_78.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:08:56.857413919Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E50TYDuCr354gdVlNjyS6_c","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.872838_79.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:08:56.872838900Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E50TYDuCr354gdVlNjyS6_c","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.934850_80.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.6","timestamp":"2021-02-13 17:08:56.934850258Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ie2Iy01UbzbWz5vfABk9fUl","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.951266_81.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.6","timestamp":"2021-02-13 17:08:56.951266414Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ie2Iy01UbzbWz5vfABk9fUl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236136.957106_82.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:08:56.957106108Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FjsXvYcvMg190djv14ASo-P","ver":1},"status":{"status":"write"}}},{"id":"1_1613236136.973626_83.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:08:56.973626594Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FjsXvYcvMg190djv14ASo-P","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.631677_84.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.7","timestamp":"2021-02-13 17:09:02.631677351Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.647548_85.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.7","timestamp":"2021-02-13 17:09:02.647548032Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.653493_86.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:02.653493574Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lrvu-9J8P0Qz9rirKPuLeSg","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.664789_87.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:02.664789113Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lrvu-9J8P0Qz9rirKPuLeSg","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236142.674711_88.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.7","timestamp":"2021-02-13 17:09:02.674711599Z","data":{"read_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":1},"write_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236142.689989_89.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.7","timestamp":"2021-02-13 17:09:02.689989837Z","data":{"read_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":1},"write_version":{"tag":"_MrJpnt9Y5rM3AQJE5IjNcy2","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236142.716861_90.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.8","timestamp":"2021-02-13 17:09:02.716861437Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.733587_91.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.8","timestamp":"2021-02-13 17:09:02.733587245Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.739866_92.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:02.739866856Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fEtN4yrcqZzdlH7Obu_wLl8","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.750685_93.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:02.750685926Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fEtN4yrcqZzdlH7Obu_wLl8","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236142.761155_94.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.8","timestamp":"2021-02-13 17:09:02.761155199Z","data":{"read_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":1},"write_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236142.775386_95.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.8","timestamp":"2021-02-13 17:09:02.775386218Z","data":{"read_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":1},"write_version":{"tag":"_qc5-5wIUC5tVdB4UdOOsdJ6","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236142.794617_96.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.9","timestamp":"2021-02-13 17:09:02.794617617Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.805719_97.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.9","timestamp":"2021-02-13 17:09:02.805719376Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.810241_98.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:02.810241733Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BbyFGtWq3GDAk_CBCFBVpbK","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.818865_99.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:02.818865566Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BbyFGtWq3GDAk_CBCFBVpbK","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236142.827228_100.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.9","timestamp":"2021-02-13 17:09:02.827228530Z","data":{"read_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":1},"write_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236142.838159_101.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.9","timestamp":"2021-02-13 17:09:02.838159819Z","data":{"read_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":1},"write_version":{"tag":"_CRTopJZ1gY8v5Ifsw2czTyO","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236142.862019_102.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.10","timestamp":"2021-02-13 17:09:02.862019577Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.872078_103.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.10","timestamp":"2021-02-13 17:09:02.872078859Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.875943_104.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:02.875943276Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5Qw8xrxcL9PbNpxRqGzgs-x","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.883891_105.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:02.883891746Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5Qw8xrxcL9PbNpxRqGzgs-x","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236142.891075_106.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.10","timestamp":"2021-02-13 17:09:02.891075869Z","data":{"read_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":1},"write_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236142.901752_107.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.10","timestamp":"2021-02-13 17:09:02.901752455Z","data":{"read_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":1},"write_version":{"tag":"_5NBrkpRCBjKQ0fBI2QRwJf3","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236142.959830_108.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.11","timestamp":"2021-02-13 17:09:02.959830129Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.975302_109.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.11","timestamp":"2021-02-13 17:09:02.975302404Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236142.980644_110.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:02.980644518Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZBgeeoKpk_cVxf28vkNxXEh","ver":1},"status":{"status":"write"}}},{"id":"1_1613236142.991050_111.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:02.991050845Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZBgeeoKpk_cVxf28vkNxXEh","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236143.000310_112.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.11","timestamp":"2021-02-13 17:09:03.000310684Z","data":{"read_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":1},"write_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236143.015207_113.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.11","timestamp":"2021-02-13 17:09:03.015207766Z","data":{"read_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":1},"write_version":{"tag":"_Af4G1FVIa6oxHKo2GFNyrRl","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236143.077484_114.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.12","timestamp":"2021-02-13 17:09:03.077484714Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.093641_115.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.12","timestamp":"2021-02-13 17:09:03.093641018Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236143.099932_116.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:03.099932950Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7n3rrkZ1z6GUeQYwqdZWlQc","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.111225_117.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:03.111225751Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7n3rrkZ1z6GUeQYwqdZWlQc","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236143.121091_118.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.12","timestamp":"2021-02-13 17:09:03.121091705Z","data":{"read_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":1},"write_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236143.136215_119.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.12","timestamp":"2021-02-13 17:09:03.136215200Z","data":{"read_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":1},"write_version":{"tag":"__lHcaBmKuoJ7TGZwxi-E3kr","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236143.240544_120.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.13","timestamp":"2021-02-13 17:09:03.240544868Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.256062_121.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.13","timestamp":"2021-02-13 17:09:03.256062169Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236143.261970_122.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:03.261970913Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_c4p9j46Ekxm24ng54KkYX5V","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.273238_123.1","section":"bucket","name":"fggivf-4","timestamp":"2021-02-13 17:09:03.273238024Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_c4p9j46Ekxm24ng54KkYX5V","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236143.283107_124.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.13","timestamp":"2021-02-13 17:09:03.283107093Z","data":{"read_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":1},"write_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236143.298002_125.1","section":"bucket.instance","name":"fggivf-4:828f8250-b337-4094-a551-9a6ba396e2f7.4334.13","timestamp":"2021-02-13 17:09:03.298002217Z","data":{"read_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":1},"write_version":{"tag":"_DvtSCz9Nmb5p5mPt36VrtlK","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236143.359814_126.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.14","timestamp":"2021-02-13 17:09:03.359814410Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.375221_127.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.14","timestamp":"2021-02-13 17:09:03.375221646Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236143.381038_128.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:03.381038078Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XvI88UZ1iLAh3aib-aaO9UX","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.391506_129.1","section":"bucket","name":"fggivf-5","timestamp":"2021-02-13 17:09:03.391506444Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XvI88UZ1iLAh3aib-aaO9UX","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236143.401486_130.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.14","timestamp":"2021-02-13 17:09:03.401486198Z","data":{"read_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":1},"write_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236143.416837_131.1","section":"bucket.instance","name":"fggivf-5:828f8250-b337-4094-a551-9a6ba396e2f7.4334.14","timestamp":"2021-02-13 17:09:03.416837625Z","data":{"read_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":1},"write_version":{"tag":"_6OKkjwsJLyCFhq1lPStJgYs","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236143.517883_132.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.15","timestamp":"2021-02-13 17:09:03.517883464Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.533432_133.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.15","timestamp":"2021-02-13 17:09:03.533432357Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236143.539825_134.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:03.539825925Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-z0jqf_7EggFfDdVF7UgGvE","ver":1},"status":{"status":"write"}}},{"id":"1_1613236143.551491_135.1","section":"bucket","name":"fggivf-6","timestamp":"2021-02-13 17:09:03.551491057Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-z0jqf_7EggFfDdVF7UgGvE","ver":1},"status":{"status":"abort"}}},{"id":"1_1613236143.561428_136.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.15","timestamp":"2021-02-13 17:09:03.561428385Z","data":{"read_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":1},"write_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236143.577282_137.1","section":"bucket.instance","name":"fggivf-6:828f8250-b337-4094-a551-9a6ba396e2f7.4334.15","timestamp":"2021-02-13 17:09:03.577282401Z","data":{"read_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":1},"write_version":{"tag":"__i1XCxl2lvGmFzCZUb-qopl","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236159.521655_138.1","section":"bucket.instance","name":"fggivf-7:828f8250-b337-4094-a551-9a6ba396e2f7.4334.16","timestamp":"2021-02-13 17:09:19.521655971Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Novyg1ni_NVvq7E3Sxcuc9j","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.538369_139.1","section":"bucket.instance","name":"fggivf-7:828f8250-b337-4094-a551-9a6ba396e2f7.4334.16","timestamp":"2021-02-13 17:09:19.538369977Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Novyg1ni_NVvq7E3Sxcuc9j","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236159.545091_140.1","section":"bucket","name":"fggivf-7","timestamp":"2021-02-13 17:09:19.545091698Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.562813_141.1","section":"bucket","name":"fggivf-7","timestamp":"2021-02-13 17:09:19.562813463Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236159.592942_142.1","section":"bucket.instance","name":"fggivf-8:828f8250-b337-4094-a551-9a6ba396e2f7.4334.17","timestamp":"2021-02-13 17:09:19.592942571Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rS5HrgXvvd0g20Kc9nZDh57","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.609255_143.1","section":"bucket.instance","name":"fggivf-8:828f8250-b337-4094-a551-9a6ba396e2f7.4334.17","timestamp":"2021-02-13 17:09:19.609255746Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rS5HrgXvvd0g20Kc9nZDh57","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236159.614994_144.1","section":"bucket","name":"fggivf-8","timestamp":"2021-02-13 17:09:19.614994093Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.630344_145.1","section":"bucket","name":"fggivf-8","timestamp":"2021-02-13 17:09:19.630344839Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236159.692632_146.1","section":"bucket.instance","name":"fggivf-9:828f8250-b337-4094-a551-9a6ba396e2f7.4334.18","timestamp":"2021-02-13 17:09:19.692632205Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3Cb1enbvLKK1av5fFEjGanj","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.708401_147.1","section":"bucket.instance","name":"fggivf-9:828f8250-b337-4094-a551-9a6ba396e2f7.4334.18","timestamp":"2021-02-13 17:09:19.708401977Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3Cb1enbvLKK1av5fFEjGanj","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236159.714476_148.1","section":"bucket","name":"fggivf-9","timestamp":"2021-02-13 17:09:19.714476498Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":1},"status":{"status":"write"}}},{"id":"1_1613236159.729777_149.1","section":"bucket","name":"fggivf-9","timestamp":"2021-02-13 17:09:19.729777247Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":1},"status":{"status":"complete"}}},{"id":"1_1613236165.416017_150.1","section":"bucket","name":"fggivf-7","timestamp":"2021-02-13 17:09:25.416017261Z","data":{"read_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":1},"write_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236165.431937_151.1","section":"bucket","name":"fggivf-7","timestamp":"2021-02-13 17:09:25.431937039Z","data":{"read_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":1},"write_version":{"tag":"_SE1_WkXyixKfCI6Pvn0BlhA","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236165.469186_152.1","section":"bucket","name":"fggivf-8","timestamp":"2021-02-13 17:09:25.469186740Z","data":{"read_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":1},"write_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236165.484451_153.1","section":"bucket","name":"fggivf-8","timestamp":"2021-02-13 17:09:25.484451837Z","data":{"read_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":1},"write_version":{"tag":"_idKDFCCnK5HmCVraIfXK89Z","ver":2},"status":{"status":"complete"}}},{"id":"1_1613236165.555023_154.1","section":"bucket","name":"fggivf-9","timestamp":"2021-02-13 17:09:25.555023108Z","data":{"read_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":1},"write_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":2},"status":{"status":"remove"}}},{"id":"1_1613236165.569853_155.1","section":"bucket","name":"fggivf-9","timestamp":"2021-02-13 17:09:25.569853904Z","data":{"read_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":1},"write_version":{"tag":"_7B8nNt_xC-CS6BSKDCb6TSH","ver":2},"status":{"status":"complete"}}}] 2021-02-13T17:49:45.801 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:45.801 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:45.802 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:45.927 INFO:teuthology.orchestra.run.gibba037.stdout:[{"id":"1_1613238513.013561_129.1","section":"bucket.instance","name":"fggivf-42:683fc559-f564-4678-9d94-a4eeda89e756.7516.1","timestamp":"2021-02-13 17:48:33.013561119Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_q8yZYYalyOIz9O8hZnHm2t6","ver":1},"status":{"status":"write"}}},{"id":"1_1613238513.028997_130.1","section":"bucket.instance","name":"fggivf-42:683fc559-f564-4678-9d94-a4eeda89e756.7516.1","timestamp":"2021-02-13 17:48:33.028997607Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_q8yZYYalyOIz9O8hZnHm2t6","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238513.034701_131.1","section":"bucket","name":"fggivf-42","timestamp":"2021-02-13 17:48:33.034701048Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5hVjY7ZGPpyzfvRxMMZlRFc","ver":1},"status":{"status":"write"}}},{"id":"1_1613238513.050231_132.1","section":"bucket","name":"fggivf-42","timestamp":"2021-02-13 17:48:33.050231972Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5hVjY7ZGPpyzfvRxMMZlRFc","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238513.115383_133.1","section":"bucket.instance","name":"fggivf-43:683fc559-f564-4678-9d94-a4eeda89e756.7516.2","timestamp":"2021-02-13 17:48:33.115383595Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ppmJ7hsnqPfIkLBFHxi4Oq7","ver":1},"status":{"status":"write"}}},{"id":"1_1613238513.130971_134.1","section":"bucket.instance","name":"fggivf-43:683fc559-f564-4678-9d94-a4eeda89e756.7516.2","timestamp":"2021-02-13 17:48:33.130971708Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ppmJ7hsnqPfIkLBFHxi4Oq7","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238513.136746_135.1","section":"bucket","name":"fggivf-43","timestamp":"2021-02-13 17:48:33.136746867Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_e4BhT-J8LHKOCuLhXlm_CQz","ver":1},"status":{"status":"write"}}},{"id":"1_1613238513.152695_136.1","section":"bucket","name":"fggivf-43","timestamp":"2021-02-13 17:48:33.152695951Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_e4BhT-J8LHKOCuLhXlm_CQz","ver":1},"status":{"status":"complete"}}}] 2021-02-13T17:49:45.927 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:45.928 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:45.928 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:46.046 INFO:teuthology.orchestra.run.gibba038.stdout:[{"id":"1_1613238513.013561_129.1","section":"bucket.instance","name":"fggivf-42:683fc559-f564-4678-9d94-a4eeda89e756.7516.1","timestamp":"2021-02-13 17:48:33.013561119Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_q8yZYYalyOIz9O8hZnHm2t6","ver":1},"status":{"status":"write"}}},{"id":"1_1613238513.028997_130.1","section":"bucket.instance","name":"fggivf-42:683fc559-f564-4678-9d94-a4eeda89e756.7516.1","timestamp":"2021-02-13 17:48:33.028997607Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_q8yZYYalyOIz9O8hZnHm2t6","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238513.034701_131.1","section":"bucket","name":"fggivf-42","timestamp":"2021-02-13 17:48:33.034701048Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5hVjY7ZGPpyzfvRxMMZlRFc","ver":1},"status":{"status":"write"}}},{"id":"1_1613238513.050231_132.1","section":"bucket","name":"fggivf-42","timestamp":"2021-02-13 17:48:33.050231972Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5hVjY7ZGPpyzfvRxMMZlRFc","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238513.115383_133.1","section":"bucket.instance","name":"fggivf-43:683fc559-f564-4678-9d94-a4eeda89e756.7516.2","timestamp":"2021-02-13 17:48:33.115383595Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ppmJ7hsnqPfIkLBFHxi4Oq7","ver":1},"status":{"status":"write"}}},{"id":"1_1613238513.130971_134.1","section":"bucket.instance","name":"fggivf-43:683fc559-f564-4678-9d94-a4eeda89e756.7516.2","timestamp":"2021-02-13 17:48:33.130971708Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ppmJ7hsnqPfIkLBFHxi4Oq7","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238513.136746_135.1","section":"bucket","name":"fggivf-43","timestamp":"2021-02-13 17:48:33.136746867Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_e4BhT-J8LHKOCuLhXlm_CQz","ver":1},"status":{"status":"write"}}},{"id":"1_1613238513.152695_136.1","section":"bucket","name":"fggivf-43","timestamp":"2021-02-13 17:48:33.152695951Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_e4BhT-J8LHKOCuLhXlm_CQz","ver":1},"status":{"status":"complete"}}}] 2021-02-13T17:49:46.047 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:46.047 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:46.047 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:46.134 INFO:teuthology.orchestra.run.gibba037.stdout:[{"id":"1_1613238513.013561_129.1","section":"bucket.instance","name":"fggivf-42:683fc559-f564-4678-9d94-a4eeda89e756.7516.1","timestamp":"2021-02-13 17:48:33.013561119Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_q8yZYYalyOIz9O8hZnHm2t6","ver":1},"status":{"status":"write"}}},{"id":"1_1613238513.028997_130.1","section":"bucket.instance","name":"fggivf-42:683fc559-f564-4678-9d94-a4eeda89e756.7516.1","timestamp":"2021-02-13 17:48:33.028997607Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_q8yZYYalyOIz9O8hZnHm2t6","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238513.034701_131.1","section":"bucket","name":"fggivf-42","timestamp":"2021-02-13 17:48:33.034701048Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5hVjY7ZGPpyzfvRxMMZlRFc","ver":1},"status":{"status":"write"}}},{"id":"1_1613238513.050231_132.1","section":"bucket","name":"fggivf-42","timestamp":"2021-02-13 17:48:33.050231972Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5hVjY7ZGPpyzfvRxMMZlRFc","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238513.115383_133.1","section":"bucket.instance","name":"fggivf-43:683fc559-f564-4678-9d94-a4eeda89e756.7516.2","timestamp":"2021-02-13 17:48:33.115383595Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ppmJ7hsnqPfIkLBFHxi4Oq7","ver":1},"status":{"status":"write"}}},{"id":"1_1613238513.130971_134.1","section":"bucket.instance","name":"fggivf-43:683fc559-f564-4678-9d94-a4eeda89e756.7516.2","timestamp":"2021-02-13 17:48:33.130971708Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ppmJ7hsnqPfIkLBFHxi4Oq7","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238513.136746_135.1","section":"bucket","name":"fggivf-43","timestamp":"2021-02-13 17:48:33.136746867Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_e4BhT-J8LHKOCuLhXlm_CQz","ver":1},"status":{"status":"write"}}},{"id":"1_1613238513.152695_136.1","section":"bucket","name":"fggivf-43","timestamp":"2021-02-13 17:48:33.152695951Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_e4BhT-J8LHKOCuLhXlm_CQz","ver":1},"status":{"status":"complete"}}}] 2021-02-13T17:49:46.134 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:46.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:46.134 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:46.257 INFO:teuthology.orchestra.run.gibba038.stdout:[{"id":"1_1613238513.013561_129.1","section":"bucket.instance","name":"fggivf-42:683fc559-f564-4678-9d94-a4eeda89e756.7516.1","timestamp":"2021-02-13 17:48:33.013561119Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_q8yZYYalyOIz9O8hZnHm2t6","ver":1},"status":{"status":"write"}}},{"id":"1_1613238513.028997_130.1","section":"bucket.instance","name":"fggivf-42:683fc559-f564-4678-9d94-a4eeda89e756.7516.1","timestamp":"2021-02-13 17:48:33.028997607Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_q8yZYYalyOIz9O8hZnHm2t6","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238513.034701_131.1","section":"bucket","name":"fggivf-42","timestamp":"2021-02-13 17:48:33.034701048Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5hVjY7ZGPpyzfvRxMMZlRFc","ver":1},"status":{"status":"write"}}},{"id":"1_1613238513.050231_132.1","section":"bucket","name":"fggivf-42","timestamp":"2021-02-13 17:48:33.050231972Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5hVjY7ZGPpyzfvRxMMZlRFc","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238513.115383_133.1","section":"bucket.instance","name":"fggivf-43:683fc559-f564-4678-9d94-a4eeda89e756.7516.2","timestamp":"2021-02-13 17:48:33.115383595Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ppmJ7hsnqPfIkLBFHxi4Oq7","ver":1},"status":{"status":"write"}}},{"id":"1_1613238513.130971_134.1","section":"bucket.instance","name":"fggivf-43:683fc559-f564-4678-9d94-a4eeda89e756.7516.2","timestamp":"2021-02-13 17:48:33.130971708Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ppmJ7hsnqPfIkLBFHxi4Oq7","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238513.136746_135.1","section":"bucket","name":"fggivf-43","timestamp":"2021-02-13 17:48:33.136746867Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_e4BhT-J8LHKOCuLhXlm_CQz","ver":1},"status":{"status":"write"}}},{"id":"1_1613238513.152695_136.1","section":"bucket","name":"fggivf-43","timestamp":"2021-02-13 17:48:33.152695951Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_e4BhT-J8LHKOCuLhXlm_CQz","ver":1},"status":{"status":"complete"}}}] 2021-02-13T17:49:46.258 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '595e1dd1-4688-4d03-af39-72f8737fa57e', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:46.258 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '595e1dd1-4688-4d03-af39-72f8737fa57e', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:46.258 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 595e1dd1-4688-4d03-af39-72f8737fa57e --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:46.346 INFO:teuthology.orchestra.run.gibba037.stdout:[{"id":"1_1613238578.667460_62.1","section":"bucket.instance","name":"fggivf-44:828f8250-b337-4094-a551-9a6ba396e2f7.4824.1","timestamp":"2021-02-13 17:49:38.667460082Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cqqLz9VQ5Ppim04TJLegTjC","ver":1},"status":{"status":"write"}}},{"id":"1_1613238578.684490_63.1","section":"bucket.instance","name":"fggivf-44:828f8250-b337-4094-a551-9a6ba396e2f7.4824.1","timestamp":"2021-02-13 17:49:38.684490397Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cqqLz9VQ5Ppim04TJLegTjC","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238578.690790_64.1","section":"bucket","name":"fggivf-44","timestamp":"2021-02-13 17:49:38.690790328Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VZF9A4skc_FKozZecPY2_4M","ver":1},"status":{"status":"write"}}},{"id":"1_1613238578.707658_65.1","section":"bucket","name":"fggivf-44","timestamp":"2021-02-13 17:49:38.707658656Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VZF9A4skc_FKozZecPY2_4M","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238578.751265_66.1","section":"bucket.instance","name":"fggivf-45:828f8250-b337-4094-a551-9a6ba396e2f7.4824.2","timestamp":"2021-02-13 17:49:38.751265588Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E9o0q0HMvQSRQlWLWHAk2vg","ver":1},"status":{"status":"write"}}},{"id":"1_1613238578.766790_67.1","section":"bucket.instance","name":"fggivf-45:828f8250-b337-4094-a551-9a6ba396e2f7.4824.2","timestamp":"2021-02-13 17:49:38.766790062Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E9o0q0HMvQSRQlWLWHAk2vg","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238578.772608_68.1","section":"bucket","name":"fggivf-45","timestamp":"2021-02-13 17:49:38.772608130Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PxXI-AAuKz6cg2s6pg0Dajx","ver":1},"status":{"status":"write"}}},{"id":"1_1613238578.788578_69.1","section":"bucket","name":"fggivf-45","timestamp":"2021-02-13 17:49:38.788578201Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PxXI-AAuKz6cg2s6pg0Dajx","ver":1},"status":{"status":"complete"}}}] 2021-02-13T17:49:46.346 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '595e1dd1-4688-4d03-af39-72f8737fa57e', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:46.347 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '595e1dd1-4688-4d03-af39-72f8737fa57e', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:46.347 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 595e1dd1-4688-4d03-af39-72f8737fa57e --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:46.474 INFO:teuthology.orchestra.run.gibba038.stdout:[{"id":"1_1613238578.667460_62.1","section":"bucket.instance","name":"fggivf-44:828f8250-b337-4094-a551-9a6ba396e2f7.4824.1","timestamp":"2021-02-13 17:49:38.667460082Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cqqLz9VQ5Ppim04TJLegTjC","ver":1},"status":{"status":"write"}}},{"id":"1_1613238578.684490_63.1","section":"bucket.instance","name":"fggivf-44:828f8250-b337-4094-a551-9a6ba396e2f7.4824.1","timestamp":"2021-02-13 17:49:38.684490397Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cqqLz9VQ5Ppim04TJLegTjC","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238578.690790_64.1","section":"bucket","name":"fggivf-44","timestamp":"2021-02-13 17:49:38.690790328Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VZF9A4skc_FKozZecPY2_4M","ver":1},"status":{"status":"write"}}},{"id":"1_1613238578.707658_65.1","section":"bucket","name":"fggivf-44","timestamp":"2021-02-13 17:49:38.707658656Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VZF9A4skc_FKozZecPY2_4M","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238578.751265_66.1","section":"bucket.instance","name":"fggivf-45:828f8250-b337-4094-a551-9a6ba396e2f7.4824.2","timestamp":"2021-02-13 17:49:38.751265588Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E9o0q0HMvQSRQlWLWHAk2vg","ver":1},"status":{"status":"write"}}},{"id":"1_1613238578.766790_67.1","section":"bucket.instance","name":"fggivf-45:828f8250-b337-4094-a551-9a6ba396e2f7.4824.2","timestamp":"2021-02-13 17:49:38.766790062Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E9o0q0HMvQSRQlWLWHAk2vg","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238578.772608_68.1","section":"bucket","name":"fggivf-45","timestamp":"2021-02-13 17:49:38.772608130Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PxXI-AAuKz6cg2s6pg0Dajx","ver":1},"status":{"status":"write"}}},{"id":"1_1613238578.788578_69.1","section":"bucket","name":"fggivf-45","timestamp":"2021-02-13 17:49:38.788578201Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PxXI-AAuKz6cg2s6pg0Dajx","ver":1},"status":{"status":"complete"}}}] 2021-02-13T17:49:46.475 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '595e1dd1-4688-4d03-af39-72f8737fa57e', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:46.475 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '595e1dd1-4688-4d03-af39-72f8737fa57e', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:46.475 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 595e1dd1-4688-4d03-af39-72f8737fa57e --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:46.558 INFO:teuthology.orchestra.run.gibba037.stdout:[{"id":"1_1613238578.667460_62.1","section":"bucket.instance","name":"fggivf-44:828f8250-b337-4094-a551-9a6ba396e2f7.4824.1","timestamp":"2021-02-13 17:49:38.667460082Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cqqLz9VQ5Ppim04TJLegTjC","ver":1},"status":{"status":"write"}}},{"id":"1_1613238578.684490_63.1","section":"bucket.instance","name":"fggivf-44:828f8250-b337-4094-a551-9a6ba396e2f7.4824.1","timestamp":"2021-02-13 17:49:38.684490397Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cqqLz9VQ5Ppim04TJLegTjC","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238578.690790_64.1","section":"bucket","name":"fggivf-44","timestamp":"2021-02-13 17:49:38.690790328Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VZF9A4skc_FKozZecPY2_4M","ver":1},"status":{"status":"write"}}},{"id":"1_1613238578.707658_65.1","section":"bucket","name":"fggivf-44","timestamp":"2021-02-13 17:49:38.707658656Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VZF9A4skc_FKozZecPY2_4M","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238578.751265_66.1","section":"bucket.instance","name":"fggivf-45:828f8250-b337-4094-a551-9a6ba396e2f7.4824.2","timestamp":"2021-02-13 17:49:38.751265588Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E9o0q0HMvQSRQlWLWHAk2vg","ver":1},"status":{"status":"write"}}},{"id":"1_1613238578.766790_67.1","section":"bucket.instance","name":"fggivf-45:828f8250-b337-4094-a551-9a6ba396e2f7.4824.2","timestamp":"2021-02-13 17:49:38.766790062Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E9o0q0HMvQSRQlWLWHAk2vg","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238578.772608_68.1","section":"bucket","name":"fggivf-45","timestamp":"2021-02-13 17:49:38.772608130Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PxXI-AAuKz6cg2s6pg0Dajx","ver":1},"status":{"status":"write"}}},{"id":"1_1613238578.788578_69.1","section":"bucket","name":"fggivf-45","timestamp":"2021-02-13 17:49:38.788578201Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PxXI-AAuKz6cg2s6pg0Dajx","ver":1},"status":{"status":"complete"}}}] 2021-02-13T17:49:46.559 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '595e1dd1-4688-4d03-af39-72f8737fa57e', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:46.559 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '595e1dd1-4688-4d03-af39-72f8737fa57e', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:46.560 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 595e1dd1-4688-4d03-af39-72f8737fa57e --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:46.654 INFO:teuthology.orchestra.run.gibba038.stdout:[{"id":"1_1613238578.667460_62.1","section":"bucket.instance","name":"fggivf-44:828f8250-b337-4094-a551-9a6ba396e2f7.4824.1","timestamp":"2021-02-13 17:49:38.667460082Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cqqLz9VQ5Ppim04TJLegTjC","ver":1},"status":{"status":"write"}}},{"id":"1_1613238578.684490_63.1","section":"bucket.instance","name":"fggivf-44:828f8250-b337-4094-a551-9a6ba396e2f7.4824.1","timestamp":"2021-02-13 17:49:38.684490397Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cqqLz9VQ5Ppim04TJLegTjC","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238578.690790_64.1","section":"bucket","name":"fggivf-44","timestamp":"2021-02-13 17:49:38.690790328Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VZF9A4skc_FKozZecPY2_4M","ver":1},"status":{"status":"write"}}},{"id":"1_1613238578.707658_65.1","section":"bucket","name":"fggivf-44","timestamp":"2021-02-13 17:49:38.707658656Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VZF9A4skc_FKozZecPY2_4M","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238578.751265_66.1","section":"bucket.instance","name":"fggivf-45:828f8250-b337-4094-a551-9a6ba396e2f7.4824.2","timestamp":"2021-02-13 17:49:38.751265588Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E9o0q0HMvQSRQlWLWHAk2vg","ver":1},"status":{"status":"write"}}},{"id":"1_1613238578.766790_67.1","section":"bucket.instance","name":"fggivf-45:828f8250-b337-4094-a551-9a6ba396e2f7.4824.2","timestamp":"2021-02-13 17:49:38.766790062Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E9o0q0HMvQSRQlWLWHAk2vg","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238578.772608_68.1","section":"bucket","name":"fggivf-45","timestamp":"2021-02-13 17:49:38.772608130Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PxXI-AAuKz6cg2s6pg0Dajx","ver":1},"status":{"status":"write"}}},{"id":"1_1613238578.788578_69.1","section":"bucket","name":"fggivf-45","timestamp":"2021-02-13 17:49:38.788578201Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PxXI-AAuKz6cg2s6pg0Dajx","ver":1},"status":{"status":"complete"}}}] 2021-02-13T17:49:46.654 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:49:46.654 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:49:46.655 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:49:46.812 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:49:46.812 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:49:46.813 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog autotrim --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:49:47.107 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:49:47.107 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:49:47.107 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:49:47.198 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:49:47.198 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:49:47.198 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog autotrim --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:49:47.470 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'efc2d01e-ebf2-4522-b313-ef15a0018fb0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:47.470 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'efc2d01e-ebf2-4522-b313-ef15a0018fb0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:47.470 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period efc2d01e-ebf2-4522-b313-ef15a0018fb0 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:47.556 INFO:teuthology.orchestra.run.gibba037.stdout:[] 2021-02-13T17:49:47.556 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'efc2d01e-ebf2-4522-b313-ef15a0018fb0', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:47.556 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'efc2d01e-ebf2-4522-b313-ef15a0018fb0', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:47.556 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period efc2d01e-ebf2-4522-b313-ef15a0018fb0 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:47.681 INFO:teuthology.orchestra.run.gibba038.stdout:[] 2021-02-13T17:49:47.681 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'efc2d01e-ebf2-4522-b313-ef15a0018fb0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:47.681 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'efc2d01e-ebf2-4522-b313-ef15a0018fb0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:47.681 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period efc2d01e-ebf2-4522-b313-ef15a0018fb0 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:47.770 INFO:teuthology.orchestra.run.gibba037.stdout:[] 2021-02-13T17:49:47.771 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'efc2d01e-ebf2-4522-b313-ef15a0018fb0', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:47.771 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'efc2d01e-ebf2-4522-b313-ef15a0018fb0', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:47.771 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period efc2d01e-ebf2-4522-b313-ef15a0018fb0 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:47.894 INFO:teuthology.orchestra.run.gibba038.stdout:[] 2021-02-13T17:49:47.895 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:47.895 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:47.895 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:47.979 INFO:teuthology.orchestra.run.gibba037.stdout:[] 2021-02-13T17:49:47.979 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:47.979 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:47.980 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:48.104 INFO:teuthology.orchestra.run.gibba038.stdout:[] 2021-02-13T17:49:48.105 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:48.105 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:48.105 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:48.191 INFO:teuthology.orchestra.run.gibba037.stdout:[] 2021-02-13T17:49:48.191 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:48.191 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:48.191 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:48.278 INFO:teuthology.orchestra.run.gibba038.stdout:[] 2021-02-13T17:49:48.278 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '595e1dd1-4688-4d03-af39-72f8737fa57e', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:48.279 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '595e1dd1-4688-4d03-af39-72f8737fa57e', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:48.279 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 595e1dd1-4688-4d03-af39-72f8737fa57e --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:48.379 INFO:teuthology.orchestra.run.gibba037.stdout:[] 2021-02-13T17:49:48.379 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '595e1dd1-4688-4d03-af39-72f8737fa57e', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:48.380 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '595e1dd1-4688-4d03-af39-72f8737fa57e', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:48.380 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 595e1dd1-4688-4d03-af39-72f8737fa57e --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:48.459 INFO:teuthology.orchestra.run.gibba038.stdout:[] 2021-02-13T17:49:48.459 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '595e1dd1-4688-4d03-af39-72f8737fa57e', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:48.460 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '595e1dd1-4688-4d03-af39-72f8737fa57e', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:48.460 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 595e1dd1-4688-4d03-af39-72f8737fa57e --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:48.583 INFO:teuthology.orchestra.run.gibba037.stdout:[] 2021-02-13T17:49:48.583 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '595e1dd1-4688-4d03-af39-72f8737fa57e', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:48.583 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '595e1dd1-4688-4d03-af39-72f8737fa57e', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:48.584 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 595e1dd1-4688-4d03-af39-72f8737fa57e --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:48.706 INFO:teuthology.orchestra.run.gibba038.stdout:[] 2021-02-13T17:49:48.707 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_multi_period_incremental_sync ... ok 2021-02-13T17:49:48.707 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-46 2021-02-13T17:49:48.771 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-47 2021-02-13T17:49:48.872 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=fggivf-48 2021-02-13T17:49:49.127 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:49.127 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:49.127 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:49.250 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"1_1613238588.999086_203.1","last_update":"2021-02-13 17:49:48.999086Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-02-13T17:49:49.251 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-02-13T17:49:49.251 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:49.251 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:49.251 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:49.339 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12498329254734520252},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613238441.805873_167.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:47:21.805873Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:49:49.339 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=1 master=1_1613238588.999086_203.1 target=1_1613238441.805873_167.1 2021-02-13T17:49:54.340 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:54.340 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:54.341 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:54.428 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12498329254734520252},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613238591.436762_205.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:49:51.436762Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:49:54.429 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-02-13T17:49:54.429 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:54.429 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:54.429 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:54.510 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"1_1613238591.436762_205.1","last_update":"2021-02-13 17:49:51.436762Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-02-13T17:49:54.510 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-02-13T17:49:54.510 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:54.510 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:54.511 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:54.585 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12489312529549451383},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613238591.436762_205.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:49:51.436762Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:49:54.585 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-02-13T17:49:54.586 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:54.586 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:54.586 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:54.668 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"1_1613238591.436762_205.1","last_update":"2021-02-13 17:49:51.436762Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-02-13T17:49:54.668 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone4 source_zone=test-zone1 2021-02-13T17:49:54.668 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:54.668 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:54.669 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:54.846 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":7615325546547900322},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613238591.436762_205.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:49:51.436762Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:49:54.846 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone4 source_zone=test-zone1 2021-02-13T17:49:54.846 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:54.847 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:54.847 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:54.964 INFO:teuthology.orchestra.run.gibba038.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"1_1613238590.319648_182.1","last_update":"2021-02-13 17:49:50.319648Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-02-13T17:49:54.964 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-02-13T17:49:54.964 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:54.964 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:54.965 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:55.084 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12876143478402394807},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613238590.319648_182.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:49:50.319648Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:49:55.085 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-02-13T17:49:55.085 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:55.085 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:55.085 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:55.206 INFO:teuthology.orchestra.run.gibba038.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"1_1613238590.319648_182.1","last_update":"2021-02-13 17:49:50.319648Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-02-13T17:49:55.206 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone2 2021-02-13T17:49:55.206 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:55.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:55.207 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:55.295 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":13320372316851528683},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613238590.319648_182.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:49:50.319648Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:49:55.295 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone2 2021-02-13T17:49:55.296 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:55.296 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:55.296 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:55.414 INFO:teuthology.orchestra.run.gibba038.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"1_1613238590.319648_182.1","last_update":"2021-02-13 17:49:50.319648Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-02-13T17:49:55.414 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone4 source_zone=test-zone2 2021-02-13T17:49:55.414 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:55.414 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:49:55.415 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:49:55.592 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:49:55.592 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:50:00.594 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:00.594 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:00.594 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:50:00.778 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:50:00.779 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:50:05.779 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:05.779 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:05.780 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:50:05.955 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:50:05.955 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:50:10.956 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:10.956 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:10.956 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:50:11.133 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:50:11.133 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:50:16.134 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:16.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:16.135 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:50:16.318 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:50:16.319 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:50:21.319 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:21.320 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:21.320 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:50:21.495 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:50:21.496 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:50:26.496 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:26.496 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:26.497 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:50:26.673 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:50:26.674 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:50:31.675 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:31.675 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:31.676 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:50:31.858 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:50:31.859 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:50:36.859 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:36.860 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:36.860 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:50:37.036 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:50:37.036 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:50:42.037 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:42.037 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:42.038 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:50:42.215 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:50:42.215 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:50:47.215 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:47.216 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:47.216 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:50:47.400 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:50:47.400 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:50:52.401 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:52.402 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:52.402 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:50:52.591 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:50:52.591 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:50:57.595 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:57.596 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:50:57.596 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:50:57.771 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:50:57.771 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:51:02.773 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:02.773 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:02.773 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:51:02.956 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:51:02.956 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:51:07.957 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:07.957 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:07.958 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:51:08.143 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:51:08.143 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:51:13.145 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:13.146 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:13.146 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:51:13.329 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:51:13.329 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:51:18.330 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:18.330 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:18.330 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:51:18.515 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:51:18.515 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:51:23.516 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:23.517 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:23.517 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:51:23.701 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:51:23.701 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:51:28.701 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:28.702 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:28.702 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:51:28.878 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:51:28.879 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:51:33.879 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:33.880 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:33.880 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:51:34.057 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:51:34.058 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:51:39.059 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:39.059 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:39.060 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:51:39.243 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:51:39.244 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:51:44.245 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:44.245 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:44.245 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:51:44.423 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:51:44.424 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:51:49.425 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:49.425 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:49.425 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:51:49.609 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:51:49.610 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:51:54.610 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:54.610 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:54.611 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:51:54.788 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:51:54.789 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:51:59.790 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:59.790 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:51:59.791 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:51:59.968 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:51:59.968 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:52:04.969 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:04.969 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:04.970 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:52:05.156 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:52:05.156 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:52:10.157 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:10.157 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:10.158 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:52:10.335 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:52:10.336 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:52:15.336 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:15.336 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:15.337 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:52:15.520 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:52:15.521 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:52:20.521 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:20.522 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:20.522 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:52:20.702 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:52:20.702 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:52:25.703 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:25.703 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:25.704 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:52:25.890 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:52:25.890 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:52:30.891 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:30.891 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:30.892 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:52:31.078 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:52:31.078 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:52:36.079 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:36.080 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:36.080 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:52:36.263 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:52:36.263 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:52:41.264 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:41.264 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:41.265 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:52:41.448 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:52:41.448 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:52:46.449 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:46.450 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:46.450 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:52:46.632 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:52:46.633 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:52:51.634 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:51.634 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:51.635 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:52:51.813 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:52:51.814 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:52:56.815 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:56.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:52:56.815 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:52:56.999 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:52:57.000 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:53:02.001 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:02.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:02.001 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:53:02.184 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:53:02.185 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:53:07.186 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:07.186 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:07.186 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:53:07.364 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:53:07.364 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:53:12.366 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:12.366 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:12.366 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:53:12.542 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:53:12.543 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:53:17.544 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:17.544 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:17.544 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:53:17.721 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:53:17.721 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:53:22.722 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:22.723 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:22.723 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:53:22.907 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:53:22.908 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:53:27.908 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:27.908 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:27.909 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:53:28.087 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:53:28.087 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:53:33.088 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:33.088 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:33.088 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:53:33.265 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:53:33.266 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:53:38.266 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:38.267 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:38.267 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:53:38.449 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:53:38.450 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:53:43.450 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:43.451 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:43.451 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:53:43.626 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:53:43.627 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:53:48.627 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:48.628 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:48.628 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:53:48.804 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:53:48.804 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:53:53.805 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:53.805 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:53.805 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:53:53.987 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:53:53.988 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:53:58.988 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:58.989 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:58.989 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:53:59.168 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:53:59.169 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:54:04.170 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:04.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:04.171 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:04.356 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:54:04.356 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:54:09.357 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:09.357 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:09.358 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:09.540 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:54:09.540 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:54:14.541 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:14.542 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:14.542 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:14.718 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:54:14.719 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:54:19.719 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:19.720 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:19.720 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:19.896 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:54:19.896 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:54:24.897 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:24.897 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:24.897 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:25.080 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:54:25.081 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:54:30.081 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:30.082 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:30.082 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:30.264 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:54:30.264 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:54:35.264 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:35.265 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:35.265 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:35.441 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:54:35.441 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:54:40.442 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:40.442 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:40.442 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:40.627 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:54:40.627 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:54:45.629 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:45.629 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:45.630 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:45.813 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:54:45.813 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:54:50.814 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:50.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:50.815 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:51.001 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:54:51.001 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:54:56.003 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:56.003 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:56.003 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:56.189 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:54:56.190 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:55:01.190 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:01.190 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:01.191 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:01.366 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T17:55:01.366 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T17:55:06.368 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_datalog_autotrim ... FAIL 2021-02-13T17:55:06.369 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:55:06.369 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:55:06.369 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --sync-from-all=false --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:55:06.414 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:55:06.410 7fa7830bf940 0 failed reading obj info from .rgw.root:zone_info.0309fa59-88d6-4791-9422-c40c249763c5: (2) No such file or directory 2021-02-13T17:55:06.414 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:55:06.410 7fa7830bf940 0 WARNING: could not read zone params for zone id=0309fa59-88d6-4791-9422-c40c249763c5 name=test-zone3 2021-02-13T17:55:06.415 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:55:06.410 7fa7830bf940 0 failed reading obj info from .rgw.root:zone_info.828f8250-b337-4094-a551-9a6ba396e2f7: (2) No such file or directory 2021-02-13T17:55:06.415 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:55:06.410 7fa7830bf940 0 WARNING: could not read zone params for zone id=828f8250-b337-4094-a551-9a6ba396e2f7 name=test-zone1 2021-02-13T17:55:06.420 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"MPD5WFU8HKLMFZF5","secret_key":"OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"} 2021-02-13T17:55:06.421 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:55:06.421 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:55:06.421 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:55:06.544 INFO:teuthology.orchestra.run.gibba038.stdout:Sending period to new master zone 828f8250-b337-4094-a551-9a6ba396e2f7 2021-02-13T17:55:07.659 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"595e1dd1-4688-4d03-af39-72f8737fa57e","epoch":2,"predecessor_uuid":"3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b","sync_status":["","","1_1613238513.152695_136.1",""],"period_map":{"id":"595e1dd1-4688-4d03-af39-72f8737fa57e","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","zones":[{"id":"0309fa59-88d6-4791-9422-c40c249763c5","name":"test-zone3","endpoints":["http://gibba037.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"64418f57-773e-4390-b4e5-412c8c3de8c5","name":"test-zone4","endpoints":["http://gibba038.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","endpoints":["http://gibba038.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"false","sync_from":[],"redirect_zone":""},{"id":"828f8250-b337-4094-a551-9a6ba396e2f7","name":"test-zone1","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"}],"short_zone_ids":[{"key":"0309fa59-88d6-4791-9422-c40c249763c5","val":2792335811},{"key":"64418f57-773e-4390-b4e5-412c8c3de8c5","val":3971286608},{"key":"683fc559-f564-4678-9d94-a4eeda89e756","val":4148686205},{"key":"828f8250-b337-4094-a551-9a6ba396e2f7","val":2513897494}]},"master_zonegroup":"test-zonegroup","master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f","realm_name":"test-realm","realm_epoch":4} 2021-02-13T17:55:07.659 INFO:rgw_multi.tests:Set sync_from_all flag on zone test-zone2 to false 2021-02-13T17:56:07.661 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-49 2021-02-13T17:56:07.783 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:07.783 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:07.783 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:07.881 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T17:56:07.895 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238967.723382_94.1","last_update":"2021-02-13 17:56:07.723382Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T17:56:07.896 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:56:07.896 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:07.896 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:07.896 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:07.976 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238588.930913_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:49:48.930913Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:07.976 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613238967.723382_94.1 target=1_1613238588.930913_84.1 2021-02-13T17:56:12.977 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:12.978 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:12.978 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:13.065 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238588.930913_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:49:48.930913Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:13.065 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613238967.723382_94.1 target=1_1613238588.930913_84.1 2021-02-13T17:56:18.066 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:18.067 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:18.067 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:18.155 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238588.930913_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:49:48.930913Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:18.156 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613238967.723382_94.1 target=1_1613238588.930913_84.1 2021-02-13T17:56:23.157 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:23.157 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:23.158 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:23.244 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238588.930913_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:49:48.930913Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:23.245 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613238967.723382_94.1 target=1_1613238588.930913_84.1 2021-02-13T17:56:28.246 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:28.246 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:28.247 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:28.331 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238588.930913_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:49:48.930913Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:28.332 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613238967.723382_94.1 target=1_1613238588.930913_84.1 2021-02-13T17:56:33.332 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:33.333 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:33.333 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:33.420 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238588.930913_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:49:48.930913Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:33.420 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613238967.723382_94.1 target=1_1613238588.930913_84.1 2021-02-13T17:56:38.422 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:38.422 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:38.422 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:38.511 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238588.930913_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:49:48.930913Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:38.511 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613238967.723382_94.1 target=1_1613238588.930913_84.1 2021-02-13T17:56:43.512 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:43.512 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:43.512 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:43.593 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238588.930913_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:49:48.930913Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:43.594 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613238967.723382_94.1 target=1_1613238588.930913_84.1 2021-02-13T17:56:48.594 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:48.595 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:48.595 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:48.683 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238588.930913_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:49:48.930913Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:48.683 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613238967.723382_94.1 target=1_1613238588.930913_84.1 2021-02-13T17:56:53.684 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:53.685 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:53.685 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:53.770 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238588.930913_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:49:48.930913Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:53.771 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613238967.723382_94.1 target=1_1613238588.930913_84.1 2021-02-13T17:56:58.771 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:58.771 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:58.772 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:58.851 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238588.930913_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:49:48.930913Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:58.851 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613238967.723382_94.1 target=1_1613238588.930913_84.1 2021-02-13T17:57:03.852 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:03.853 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:03.853 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:57:03.939 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238588.930913_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:49:48.930913Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:57:03.939 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613238967.723382_94.1 target=1_1613238588.930913_84.1 2021-02-13T17:57:08.941 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:08.941 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:08.941 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:57:09.060 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238967.723382_94.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:07.723382Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:57:09.060 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:57:09.061 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:57:09.061 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:09.061 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:09.061 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:57:09.176 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238967.723382_94.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:07.723382Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:57:09.176 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:57:09.177 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:57:09.177 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:09.177 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:09.177 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:57:09.394 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238967.723382_94.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:07.723382Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:57:09.394 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:57:09.420 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=828f8250-b337-4094-a551-9a6ba396e2f7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:57:09.421 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=828f8250-b337-4094-a551-9a6ba396e2f7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:57:09.421 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --redirect-zone=828f8250-b337-4094-a551-9a6ba396e2f7 --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:57:09.496 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:57:09.487 7fe0763f0940 0 failed reading obj info from .rgw.root:zone_info.0309fa59-88d6-4791-9422-c40c249763c5: (2) No such file or directory 2021-02-13T17:57:09.496 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:57:09.487 7fe0763f0940 0 WARNING: could not read zone params for zone id=0309fa59-88d6-4791-9422-c40c249763c5 name=test-zone3 2021-02-13T17:57:09.497 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:57:09.487 7fe0763f0940 0 failed reading obj info from .rgw.root:zone_info.828f8250-b337-4094-a551-9a6ba396e2f7: (2) No such file or directory 2021-02-13T17:57:09.497 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:57:09.487 7fe0763f0940 0 WARNING: could not read zone params for zone id=828f8250-b337-4094-a551-9a6ba396e2f7 name=test-zone1 2021-02-13T17:57:09.503 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"MPD5WFU8HKLMFZF5","secret_key":"OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"} 2021-02-13T17:57:09.504 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:57:09.504 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:57:09.504 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:57:09.590 INFO:teuthology.orchestra.run.gibba038.stdout:Sending period to new master zone 828f8250-b337-4094-a551-9a6ba396e2f7 2021-02-13T17:57:10.786 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"595e1dd1-4688-4d03-af39-72f8737fa57e","epoch":3,"predecessor_uuid":"3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b","sync_status":["","","1_1613238513.152695_136.1",""],"period_map":{"id":"595e1dd1-4688-4d03-af39-72f8737fa57e","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","zones":[{"id":"0309fa59-88d6-4791-9422-c40c249763c5","name":"test-zone3","endpoints":["http://gibba037.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"64418f57-773e-4390-b4e5-412c8c3de8c5","name":"test-zone4","endpoints":["http://gibba038.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","endpoints":["http://gibba038.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"false","sync_from":[],"redirect_zone":"828f8250-b337-4094-a551-9a6ba396e2f7"},{"id":"828f8250-b337-4094-a551-9a6ba396e2f7","name":"test-zone1","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"}],"short_zone_ids":[{"key":"0309fa59-88d6-4791-9422-c40c249763c5","val":2792335811},{"key":"64418f57-773e-4390-b4e5-412c8c3de8c5","val":3971286608},{"key":"683fc559-f564-4678-9d94-a4eeda89e756","val":4148686205},{"key":"828f8250-b337-4094-a551-9a6ba396e2f7","val":2513897494}]},"master_zonegroup":"test-zonegroup","master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f","realm_name":"test-realm","realm_epoch":4} 2021-02-13T17:57:10.786 INFO:rgw_multi.tests:Set redirect_zone zone test-zone2 to "828f8250-b337-4094-a551-9a6ba396e2f7" 2021-02-13T17:58:11.207 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=true', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:58:11.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=true', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:58:11.208 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --sync-from-all=true --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:58:11.252 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:58:11.244 7f8896eb1940 0 failed reading obj info from .rgw.root:zone_info.0309fa59-88d6-4791-9422-c40c249763c5: (2) No such file or directory 2021-02-13T17:58:11.253 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:58:11.244 7f8896eb1940 0 WARNING: could not read zone params for zone id=0309fa59-88d6-4791-9422-c40c249763c5 name=test-zone3 2021-02-13T17:58:11.253 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:58:11.248 7f8896eb1940 0 failed reading obj info from .rgw.root:zone_info.828f8250-b337-4094-a551-9a6ba396e2f7: (2) No such file or directory 2021-02-13T17:58:11.253 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:58:11.248 7f8896eb1940 0 WARNING: could not read zone params for zone id=828f8250-b337-4094-a551-9a6ba396e2f7 name=test-zone1 2021-02-13T17:58:11.259 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"MPD5WFU8HKLMFZF5","secret_key":"OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"} 2021-02-13T17:58:11.259 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:58:11.260 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:58:11.260 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:58:11.384 INFO:teuthology.orchestra.run.gibba038.stdout:Sending period to new master zone 828f8250-b337-4094-a551-9a6ba396e2f7 2021-02-13T17:58:12.575 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"595e1dd1-4688-4d03-af39-72f8737fa57e","epoch":4,"predecessor_uuid":"3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b","sync_status":["","","1_1613238513.152695_136.1",""],"period_map":{"id":"595e1dd1-4688-4d03-af39-72f8737fa57e","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","zones":[{"id":"0309fa59-88d6-4791-9422-c40c249763c5","name":"test-zone3","endpoints":["http://gibba037.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"64418f57-773e-4390-b4e5-412c8c3de8c5","name":"test-zone4","endpoints":["http://gibba038.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","endpoints":["http://gibba038.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":"828f8250-b337-4094-a551-9a6ba396e2f7"},{"id":"828f8250-b337-4094-a551-9a6ba396e2f7","name":"test-zone1","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"}],"short_zone_ids":[{"key":"0309fa59-88d6-4791-9422-c40c249763c5","val":2792335811},{"key":"64418f57-773e-4390-b4e5-412c8c3de8c5","val":3971286608},{"key":"683fc559-f564-4678-9d94-a4eeda89e756","val":4148686205},{"key":"828f8250-b337-4094-a551-9a6ba396e2f7","val":2513897494}]},"master_zonegroup":"test-zonegroup","master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f","realm_name":"test-realm","realm_epoch":4} 2021-02-13T17:58:12.575 INFO:rgw_multi.tests:Set sync_from_all flag on zone test-zone2 to true 2021-02-13T17:59:12.576 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:59:12.577 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:59:12.577 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --redirect-zone= --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:59:12.617 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:59:12.609 7f61ca034940 0 failed reading obj info from .rgw.root:zone_info.0309fa59-88d6-4791-9422-c40c249763c5: (2) No such file or directory 2021-02-13T17:59:12.617 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:59:12.609 7f61ca034940 0 WARNING: could not read zone params for zone id=0309fa59-88d6-4791-9422-c40c249763c5 name=test-zone3 2021-02-13T17:59:12.617 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:59:12.613 7f61ca034940 0 failed reading obj info from .rgw.root:zone_info.828f8250-b337-4094-a551-9a6ba396e2f7: (2) No such file or directory 2021-02-13T17:59:12.617 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 17:59:12.613 7f61ca034940 0 WARNING: could not read zone params for zone id=828f8250-b337-4094-a551-9a6ba396e2f7 name=test-zone1 2021-02-13T17:59:12.623 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"MPD5WFU8HKLMFZF5","secret_key":"OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"} 2021-02-13T17:59:12.624 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:59:12.624 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:59:12.624 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:59:12.738 INFO:teuthology.orchestra.run.gibba038.stdout:Sending period to new master zone 828f8250-b337-4094-a551-9a6ba396e2f7 2021-02-13T17:59:13.882 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"595e1dd1-4688-4d03-af39-72f8737fa57e","epoch":5,"predecessor_uuid":"3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b","sync_status":["","","1_1613238513.152695_136.1",""],"period_map":{"id":"595e1dd1-4688-4d03-af39-72f8737fa57e","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","zones":[{"id":"0309fa59-88d6-4791-9422-c40c249763c5","name":"test-zone3","endpoints":["http://gibba037.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"64418f57-773e-4390-b4e5-412c8c3de8c5","name":"test-zone4","endpoints":["http://gibba038.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","endpoints":["http://gibba038.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"828f8250-b337-4094-a551-9a6ba396e2f7","name":"test-zone1","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"}],"short_zone_ids":[{"key":"0309fa59-88d6-4791-9422-c40c249763c5","val":2792335811},{"key":"64418f57-773e-4390-b4e5-412c8c3de8c5","val":3971286608},{"key":"683fc559-f564-4678-9d94-a4eeda89e756","val":4148686205},{"key":"828f8250-b337-4094-a551-9a6ba396e2f7","val":2513897494}]},"master_zonegroup":"test-zonegroup","master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f","realm_name":"test-realm","realm_epoch":4} 2021-02-13T17:59:13.882 INFO:rgw_multi.tests:Set redirect_zone zone test-zone2 to "" 2021-02-13T18:00:13.884 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_multi_zone_redirect ... ok 2021-02-13T18:00:13.886 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:13.886 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:13.886 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:13.953 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:00:13.970 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238967.723382_94.1","last_update":"2021-02-13 17:56:07.723382Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:00:13.970 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:00:13.971 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:13.971 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:13.971 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:14.058 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238967.723382_94.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:07.723382Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:00:14.059 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:00:14.059 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:00:14.059 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:14.059 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:14.060 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:14.145 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238967.723382_94.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:07.723382Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:00:14.146 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:00:14.146 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:00:14.146 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:14.146 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:14.146 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:14.324 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238967.723382_94.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:07.723382Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:00:14.325 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:00:14.325 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'MPD5WFU8HKLMFZF5', '--secret', 'OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:14.326 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'MPD5WFU8HKLMFZF5', '--secret', 'OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:14.326 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --access-key MPD5WFU8HKLMFZF5 --secret OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T18:00:14.385 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 18:00:14.377 7effc44b2940 0 failed reading obj info from .rgw.root:zone_info.0309fa59-88d6-4791-9422-c40c249763c5: (2) No such file or directory 2021-02-13T18:00:14.385 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 18:00:14.377 7effc44b2940 0 WARNING: could not read zone params for zone id=0309fa59-88d6-4791-9422-c40c249763c5 name=test-zone3 2021-02-13T18:00:14.385 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 18:00:14.381 7effc44b2940 0 failed reading obj info from .rgw.root:zone_info.828f8250-b337-4094-a551-9a6ba396e2f7: (2) No such file or directory 2021-02-13T18:00:14.386 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 18:00:14.381 7effc44b2940 0 WARNING: could not read zone params for zone id=828f8250-b337-4094-a551-9a6ba396e2f7 name=test-zone1 2021-02-13T18:00:14.390 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"c9a94edb-fcd7-4528-966a-0c76d2bcb83f","name":"remove","domain_root":"remove.rgw.meta:root","control_pool":"remove.rgw.control","gc_pool":"remove.rgw.log:gc","lc_pool":"remove.rgw.log:lc","log_pool":"remove.rgw.log","intent_log_pool":"remove.rgw.log:intent","usage_log_pool":"remove.rgw.log:usage","reshard_pool":"remove.rgw.log:reshard","user_keys_pool":"remove.rgw.meta:users.keys","user_email_pool":"remove.rgw.meta:users.email","user_swift_pool":"remove.rgw.meta:users.swift","user_uid_pool":"remove.rgw.meta:users.uid","otp_pool":"remove.rgw.otp","system_key":{"access_key":"MPD5WFU8HKLMFZF5","secret_key":"OpXvmgh8cCbD5bonJRIfESqW7fEUBPhH"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"remove.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"remove.rgw.buckets.data"}},"data_extra_pool":"remove.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"} 2021-02-13T18:00:14.391 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:14.391 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:14.391 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T18:00:19.721 INFO:teuthology.orchestra.run.gibba038.stdout:Sending period to new master zone 828f8250-b337-4094-a551-9a6ba396e2f7 2021-02-13T18:00:20.843 INFO:teuthology.orchestra.run.gibba038.stdout:{"id":"595e1dd1-4688-4d03-af39-72f8737fa57e","epoch":6,"predecessor_uuid":"3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b","sync_status":["","","1_1613238513.152695_136.1",""],"period_map":{"id":"595e1dd1-4688-4d03-af39-72f8737fa57e","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","zones":[{"id":"0309fa59-88d6-4791-9422-c40c249763c5","name":"test-zone3","endpoints":["http://gibba037.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"64418f57-773e-4390-b4e5-412c8c3de8c5","name":"test-zone4","endpoints":["http://gibba038.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","endpoints":["http://gibba038.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"828f8250-b337-4094-a551-9a6ba396e2f7","name":"test-zone1","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"c9a94edb-fcd7-4528-966a-0c76d2bcb83f","name":"remove","endpoints":[],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"}],"short_zone_ids":[{"key":"0309fa59-88d6-4791-9422-c40c249763c5","val":2792335811},{"key":"64418f57-773e-4390-b4e5-412c8c3de8c5","val":3971286608},{"key":"683fc559-f564-4678-9d94-a4eeda89e756","val":4148686205},{"key":"828f8250-b337-4094-a551-9a6ba396e2f7","val":2513897494},{"key":"c9a94edb-fcd7-4528-966a-0c76d2bcb83f","val":3445871398}]},"master_zonegroup":"test-zonegroup","master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f","realm_name":"test-realm","realm_epoch":4} 2021-02-13T18:00:20.844 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:20.844 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:20.844 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --rgw-zone remove --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:00:20.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 18:00:20.896 7fb01af23940 0 failed reading obj info from .rgw.root:zone_info.64418f57-773e-4390-b4e5-412c8c3de8c5: (2) No such file or directory 2021-02-13T18:00:20.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 18:00:20.896 7fb01af23940 0 WARNING: could not read zone params for zone id=64418f57-773e-4390-b4e5-412c8c3de8c5 name=test-zone4 2021-02-13T18:00:20.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 18:00:20.900 7fb01af23940 0 failed reading obj info from .rgw.root:zone_info.683fc559-f564-4678-9d94-a4eeda89e756: (2) No such file or directory 2021-02-13T18:00:20.905 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 18:00:20.900 7fb01af23940 0 WARNING: could not read zone params for zone id=683fc559-f564-4678-9d94-a4eeda89e756 name=test-zone2 2021-02-13T18:00:20.909 INFO:teuthology.orchestra.run.gibba037.stdout:{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","zones":[{"id":"0309fa59-88d6-4791-9422-c40c249763c5","name":"test-zone3","endpoints":["http://gibba037.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"64418f57-773e-4390-b4e5-412c8c3de8c5","name":"test-zone4","endpoints":["http://gibba038.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","endpoints":["http://gibba038.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"828f8250-b337-4094-a551-9a6ba396e2f7","name":"test-zone1","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"} 2021-02-13T18:00:20.909 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:20.909 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:20.910 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --rgw-zone remove --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:00:20.943 INFO:teuthology.orchestra.run.gibba037.stderr:zone name remove not found in zonegroup test-zonegroup 2021-02-13T18:00:20.946 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-02-13T18:00:20.946 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'delete', '--rgw-zone', 'remove', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:20.946 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'delete', '--rgw-zone', 'remove', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:20.946 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone delete --rgw-zone remove --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T18:00:21.030 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 18:00:21.025 7fc7913ca940 0 failed reading obj info from .rgw.root:zone_info.0309fa59-88d6-4791-9422-c40c249763c5: (2) No such file or directory 2021-02-13T18:00:21.031 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 18:00:21.025 7fc7913ca940 0 WARNING: could not read zone params for zone id=0309fa59-88d6-4791-9422-c40c249763c5 name=test-zone3 2021-02-13T18:00:21.031 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 18:00:21.025 7fc7913ca940 0 failed reading obj info from .rgw.root:zone_info.828f8250-b337-4094-a551-9a6ba396e2f7: (2) No such file or directory 2021-02-13T18:00:21.032 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 18:00:21.025 7fc7913ca940 0 WARNING: could not read zone params for zone id=828f8250-b337-4094-a551-9a6ba396e2f7 name=test-zone1 2021-02-13T18:00:21.034 INFO:teuthology.orchestra.run.gibba038.stderr:2021-02-13 18:00:21.029 7fc7913ca940 0 zone id c9a94edb-fcd7-4528-966a-0c76d2bcb83f is not a part of zonegroup default 2021-02-13T18:00:21.042 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:21.042 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:21.042 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:00:21.084 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 18:00:21.076 7f718400f940 0 WARNING: can't generate connection for zone c9a94edb-fcd7-4528-966a-0c76d2bcb83f id remove: no endpoints defined 2021-02-13T18:00:21.121 INFO:tasks.rgw.c1.client.1.gibba037.stdout:2021-02-13 18:00:21.112 7f700f09c700 -1 failed to decode period 2021-02-13T18:00:21.121 INFO:tasks.rgw.c2.client.0.gibba038.stdout:2021-02-13 18:00:21.113 7ff1c8584700 -1 failed to decode period 2021-02-13T18:00:21.122 INFO:tasks.rgw.c2.client.1.gibba038.stdout:2021-02-13 18:00:21.113 7f67ed1c0700 -1 failed to decode period 2021-02-13T18:00:21.132 INFO:teuthology.orchestra.run.gibba037.stdout:{"id":"595e1dd1-4688-4d03-af39-72f8737fa57e","epoch":7,"predecessor_uuid":"3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b","sync_status":["","","1_1613238513.152695_136.1",""],"period_map":{"id":"595e1dd1-4688-4d03-af39-72f8737fa57e","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","zones":[{"id":"0309fa59-88d6-4791-9422-c40c249763c5","name":"test-zone3","endpoints":["http://gibba037.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"64418f57-773e-4390-b4e5-412c8c3de8c5","name":"test-zone4","endpoints":["http://gibba038.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","endpoints":["http://gibba038.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"828f8250-b337-4094-a551-9a6ba396e2f7","name":"test-zone1","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"}],"short_zone_ids":[{"key":"0309fa59-88d6-4791-9422-c40c249763c5","val":2792335811},{"key":"64418f57-773e-4390-b4e5-412c8c3de8c5","val":3971286608},{"key":"683fc559-f564-4678-9d94-a4eeda89e756","val":4148686205},{"key":"828f8250-b337-4094-a551-9a6ba396e2f7","val":2513897494}]},"master_zonegroup":"test-zonegroup","master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f","realm_name":"test-realm","realm_epoch":4} 2021-02-13T18:00:21.133 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_zonegroup_remove ... ok 2021-02-13T18:00:21.133 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'create', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:21.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'create', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:21.133 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup create --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:00:21.206 INFO:teuthology.orchestra.run.gibba037.stdout:{"id":"553c1e04-5875-456f-acfe-8d155d818882","name":"remove_zg","api_name":"remove_zg","is_master":"false","endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"","zones":[],"placement_targets":[],"default_placement":"","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"} 2021-02-13T18:00:21.206 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:21.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:21.207 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone remove --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:00:21.340 INFO:teuthology.orchestra.run.gibba037.stdout:{"id":"84c37bdc-c973-48ee-b546-6b886b798b7a","name":"remove","domain_root":"remove.rgw.meta:root","control_pool":"remove.rgw.control","gc_pool":"remove.rgw.log:gc","lc_pool":"remove.rgw.log:lc","log_pool":"remove.rgw.log","intent_log_pool":"remove.rgw.log:intent","usage_log_pool":"remove.rgw.log:usage","reshard_pool":"remove.rgw.log:reshard","user_keys_pool":"remove.rgw.meta:users.keys","user_email_pool":"remove.rgw.meta:users.email","user_swift_pool":"remove.rgw.meta:users.swift","user_uid_pool":"remove.rgw.meta:users.uid","otp_pool":"remove.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"remove.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"remove.rgw.buckets.data"}},"data_extra_pool":"remove.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"} 2021-02-13T18:00:21.341 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:21.341 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:21.341 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:00:21.439 INFO:tasks.rgw.c1.client.1.gibba037.stdout:2021-02-13 18:00:21.432 7f7005889700 -1 failed to decode period 2021-02-13T18:00:21.440 INFO:tasks.rgw.c2.client.1.gibba038.stdout:2021-02-13 18:00:21.434 7f67e61b2700 -1 failed to decode period 2021-02-13T18:00:21.440 INFO:tasks.rgw.c2.client.0.gibba038.stdout:2021-02-13 18:00:21.434 7ff1d559e700 -1 failed to decode period 2021-02-13T18:00:21.452 INFO:teuthology.orchestra.run.gibba037.stdout:{"id":"595e1dd1-4688-4d03-af39-72f8737fa57e","epoch":8,"predecessor_uuid":"3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b","sync_status":["","","1_1613238513.152695_136.1",""],"period_map":{"id":"595e1dd1-4688-4d03-af39-72f8737fa57e","zonegroups":[{"id":"553c1e04-5875-456f-acfe-8d155d818882","name":"remove_zg","api_name":"remove_zg","is_master":"false","endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"84c37bdc-c973-48ee-b546-6b886b798b7a","zones":[{"id":"84c37bdc-c973-48ee-b546-6b886b798b7a","name":"remove","endpoints":[],"log_meta":"false","log_data":"false","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"},{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","zones":[{"id":"0309fa59-88d6-4791-9422-c40c249763c5","name":"test-zone3","endpoints":["http://gibba037.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"64418f57-773e-4390-b4e5-412c8c3de8c5","name":"test-zone4","endpoints":["http://gibba038.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","endpoints":["http://gibba038.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"828f8250-b337-4094-a551-9a6ba396e2f7","name":"test-zone1","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"}],"short_zone_ids":[{"key":"0309fa59-88d6-4791-9422-c40c249763c5","val":2792335811},{"key":"64418f57-773e-4390-b4e5-412c8c3de8c5","val":3971286608},{"key":"683fc559-f564-4678-9d94-a4eeda89e756","val":4148686205},{"key":"828f8250-b337-4094-a551-9a6ba396e2f7","val":2513897494},{"key":"84c37bdc-c973-48ee-b546-6b886b798b7a","val":2128785782}]},"master_zonegroup":"test-zonegroup","master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f","realm_name":"test-realm","realm_epoch":4} 2021-02-13T18:00:21.453 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'delete', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:21.453 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'delete', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:21.453 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone delete --rgw-zone remove --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:00:21.499 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 18:00:21.492 7fab77655940 0 zone id 84c37bdc-c973-48ee-b546-6b886b798b7a is not a part of zonegroup test-zonegroup 2021-02-13T18:00:21.500 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 18:00:21.492 7fab77655940 0 zone id 84c37bdc-c973-48ee-b546-6b886b798b7a is not a part of zonegroup default 2021-02-13T18:00:21.505 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:21.505 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:21.505 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:00:21.545 INFO:teuthology.orchestra.run.gibba037.stderr:2021-02-13 18:00:21.540 7f3804895940 0 ERROR: zonegroup remove_zg has a non existent master zone 2021-02-13T18:00:21.548 DEBUG:teuthology.orchestra.run:got remote process result: 22 2021-02-13T18:00:21.548 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'delete', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:21.548 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'delete', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:21.549 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup delete --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:00:21.621 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:21.622 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:21.622 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:00:21.754 INFO:teuthology.orchestra.run.gibba037.stdout:{"id":"595e1dd1-4688-4d03-af39-72f8737fa57e","epoch":9,"predecessor_uuid":"3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b","sync_status":["","","1_1613238513.152695_136.1",""],"period_map":{"id":"595e1dd1-4688-4d03-af39-72f8737fa57e","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","zones":[{"id":"0309fa59-88d6-4791-9422-c40c249763c5","name":"test-zone3","endpoints":["http://gibba037.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"64418f57-773e-4390-b4e5-412c8c3de8c5","name":"test-zone4","endpoints":["http://gibba038.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"683fc559-f564-4678-9d94-a4eeda89e756","name":"test-zone2","endpoints":["http://gibba038.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"828f8250-b337-4094-a551-9a6ba396e2f7","name":"test-zone1","endpoints":["http://gibba037.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f"}],"short_zone_ids":[{"key":"0309fa59-88d6-4791-9422-c40c249763c5","val":2792335811},{"key":"64418f57-773e-4390-b4e5-412c8c3de8c5","val":3971286608},{"key":"683fc559-f564-4678-9d94-a4eeda89e756","val":4148686205},{"key":"828f8250-b337-4094-a551-9a6ba396e2f7","val":2513897494}]},"master_zonegroup":"test-zonegroup","master_zone":"828f8250-b337-4094-a551-9a6ba396e2f7","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"ba7ca85e-f700-4f2a-9213-44136dc07f4f","realm_name":"test-realm","realm_epoch":4} 2021-02-13T18:00:21.755 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_zg_master_zone_delete ... ok 2021-02-13T18:00:21.755 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-50 2021-02-13T18:00:21.790 INFO:tasks.rgw.c1.client.1.gibba037.stdout:2021-02-13 18:00:21.784 7f7005088700 -1 failed to decode period 2021-02-13T18:00:21.791 INFO:tasks.rgw.c2.client.1.gibba038.stdout:2021-02-13 18:00:21.786 7f67ec9bf700 -1 failed to decode period 2021-02-13T18:00:21.791 INFO:tasks.rgw.c2.client.0.gibba038.stdout:2021-02-13 18:00:21.786 7ff1c1576700 -1 failed to decode period 2021-02-13T18:00:21.806 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-51 2021-02-13T18:00:21.870 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=fggivf-52 2021-02-13T18:00:21.898 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-53 2021-02-13T18:00:21.911 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-54 2021-02-13T18:00:21.967 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=fggivf-55 2021-02-13T18:00:24.398 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_set_bucket_website ... tasks.rgw_multi.tests.test_set_bucket_policy ... ok 2021-02-13T18:00:24.399 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-56 2021-02-13T18:00:24.460 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-57 2021-02-13T18:00:24.557 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=fggivf-58 2021-02-13T18:00:24.655 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'fggivf-56', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:24.655 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'fggivf-56', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:24.655 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket fggivf-56 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:00:24.776 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'fggivf-57', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:24.776 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'fggivf-57', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:24.776 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket fggivf-57 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:00:24.878 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'fggivf-58', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:24.878 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'fggivf-58', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:00:24.878 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket fggivf-58 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:00:24.982 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['log', 'list', '--rgw-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:24.982 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'log', 'list', '--rgw-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:24.982 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 log list --rgw-zone test-zone1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:25.085 INFO:teuthology.orchestra.run.gibba037.stdout:["2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.3-fggivf-3","obj_delete_at_hint.0000000078","meta.history","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.28-fggivf-19","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-10:828f8250-b337-4094-a551-9a6ba396e2f7.4334.19","meta.log.595e1dd1-4688-4d03-af39-72f8737fa57e.2","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.1-fggivf-1","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.33-fggivf-24","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-14:828f8250-b337-4094-a551-9a6ba396e2f7.4334.23","obj_delete_at_hint.0000000040","meta.full-sync.index.0","obj_delete_at_hint.0000000015","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.18-fggivf-9","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","data.full-sync.index.0309fa59-88d6-4791-9422-c40c249763c5.3","data.full-sync.index.683fc559-f564-4678-9d94-a4eeda89e756.0","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.25-fggivf-16","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.41-fggivf-32","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","datalog.sync-status.0309fa59-88d6-4791-9422-c40c249763c5","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4824.1-fggivf-44","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.37-fggivf-28","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4824.3-fggivf-46","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-37:828f8250-b337-4094-a551-9a6ba396e2f7.4334.46","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.2-fggivf-2","obj_delete_at_hint.0000000110","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.42-fggivf-33","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","obj_delete_at_hint.0000000006","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-12:828f8250-b337-4094-a551-9a6ba396e2f7.4334.21","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.47-fggivf-38","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","bilog.trim","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-20:828f8250-b337-4094-a551-9a6ba396e2f7.4334.29","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-12:828f8250-b337-4094-a551-9a6ba396e2f7.4334.21","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.45-fggivf-36","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","2021-02-13-18-828f8250-b337-4094-a551-9a6ba396e2f7.5104.9-fggivf-58","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.17-fggivf-8","datalog.sync-status.shard.0309fa59-88d6-4791-9422-c40c249763c5.3.retry","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","data.full-sync.index.683fc559-f564-4678-9d94-a4eeda89e756.1","obj_delete_at_hint.0000000064","datalog.sync-status.shard.0309fa59-88d6-4791-9422-c40c249763c5.1","obj_delete_at_hint.0000000071","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.21-fggivf-12","obj_delete_at_hint.0000000074","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","data_log.1","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.30-fggivf-21","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.26-fggivf-17","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","meta.full-sync.index.1","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-47:828f8250-b337-4094-a551-9a6ba396e2f7.4824.4","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","2021-02-13-18-828f8250-b337-4094-a551-9a6ba396e2f7.5104.7-fggivf-56","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-48:828f8250-b337-4094-a551-9a6ba396e2f7.4824.5","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-46:828f8250-b337-4094-a551-9a6ba396e2f7.4824.3","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-14:828f8250-b337-4094-a551-9a6ba396e2f7.4334.23","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.44-fggivf-35","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4972.1-fggivf-49","datalog.sync-status.shard.683fc559-f564-4678-9d94-a4eeda89e756.1","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-10:828f8250-b337-4094-a551-9a6ba396e2f7.4334.19","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","mdlog.sync-status.shard.2","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.43-fggivf-34","obj_delete_at_hint.0000000045","2021-02-13-18-828f8250-b337-4094-a551-9a6ba396e2f7.5104.4-fggivf-53","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-13:828f8250-b337-4094-a551-9a6ba396e2f7.4334.22","obj_delete_at_hint.0000000002","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","datalog.sync-status.683fc559-f564-4678-9d94-a4eeda89e756","obj_delete_at_hint.0000000116","datalog.sync-status.shard.0309fa59-88d6-4791-9422-c40c249763c5.0","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-15:828f8250-b337-4094-a551-9a6ba396e2f7.4334.24","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-49:828f8250-b337-4094-a551-9a6ba396e2f7.4972.1","mdlog.sync-status.shard.1","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.46-fggivf-37","2021-02-13-18-828f8250-b337-4094-a551-9a6ba396e2f7.5104.8-fggivf-57","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","2021-02-13-18-828f8250-b337-4094-a551-9a6ba396e2f7.5104.1-fggivf-50","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-38:828f8250-b337-4094-a551-9a6ba396e2f7.4334.47","datalog.sync-status.shard.683fc559-f564-4678-9d94-a4eeda89e756.2","obj_delete_at_hint.0000000066","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.27-fggivf-18","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-11:828f8250-b337-4094-a551-9a6ba396e2f7.4334.20","data.full-sync.index.0309fa59-88d6-4791-9422-c40c249763c5.2","2021-02-13-17-683fc559-f564-4678-9d94-a4eeda89e756.7516.1-fggivf-42","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.24-fggivf-15","meta.full-sync.index.3","obj_delete_at_hint.0000000118","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","obj_delete_at_hint.0000000036","data.full-sync.index.0309fa59-88d6-4791-9422-c40c249763c5.0","datalog.sync-status.shard.0309fa59-88d6-4791-9422-c40c249763c5.1.retry","obj_delete_at_hint.0000000103","mdlog.sync-status.shard.3","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","mdlog.sync-status.shard.0","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.32-fggivf-23","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.4-fggivf-4","obj_delete_at_hint.0000000039","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-36:828f8250-b337-4094-a551-9a6ba396e2f7.4334.45","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.19-fggivf-10","obj_delete_at_hint.0000000100","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.29-fggivf-20","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.50-fggivf-41","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.6-fggivf-6","datalog.sync-status.shard.0309fa59-88d6-4791-9422-c40c249763c5.2","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","sync.error-log.2","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-15:828f8250-b337-4094-a551-9a6ba396e2f7.4334.24","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.22-fggivf-13","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4824.2-fggivf-45","obj_delete_at_hint.0000000012","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.40-fggivf-31","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.38-fggivf-29","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-36:828f8250-b337-4094-a551-9a6ba396e2f7.4334.45","2021-02-13-18-828f8250-b337-4094-a551-9a6ba396e2f7.5104.3-fggivf-52","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.35-fggivf-26","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.36-fggivf-27","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","2021-02-13-17-683fc559-f564-4678-9d94-a4eeda89e756.7516.2-fggivf-43","obj_delete_at_hint.0000000115","sync.error-log.1","obj_delete_at_hint.0000000033","2021-02-13-18-828f8250-b337-4094-a551-9a6ba396e2f7.5104.2-fggivf-51","datalog.sync-status.shard.683fc559-f564-4678-9d94-a4eeda89e756.1.retry","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-13:828f8250-b337-4094-a551-9a6ba396e2f7.4334.22","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.39-fggivf-30","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.49-fggivf-40","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-20:828f8250-b337-4094-a551-9a6ba396e2f7.4334.29","obj_delete_at_hint.0000000108","datalog.sync-status.shard.0309fa59-88d6-4791-9422-c40c249763c5.3","datalog.sync-status.shard.683fc559-f564-4678-9d94-a4eeda89e756.3","obj_delete_at_hint.0000000094","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.31-fggivf-22","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-48:828f8250-b337-4094-a551-9a6ba396e2f7.4824.5","datalog.sync-status.shard.0309fa59-88d6-4791-9422-c40c249763c5.0.retry","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-46:828f8250-b337-4094-a551-9a6ba396e2f7.4824.3","obj_delete_at_hint.0000000046","meta.full-sync.index.2","obj_delete_at_hint.0000000067","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-37:828f8250-b337-4094-a551-9a6ba396e2f7.4334.46","obj_delete_at_hint.0000000086","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.16-fggivf-7","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-38:828f8250-b337-4094-a551-9a6ba396e2f7.4334.47","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-47:828f8250-b337-4094-a551-9a6ba396e2f7.4824.4","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.34-fggivf-25","data.full-sync.index.0309fa59-88d6-4791-9422-c40c249763c5.1","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-11:828f8250-b337-4094-a551-9a6ba396e2f7.4334.20","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.5-fggivf-5","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-49:828f8250-b337-4094-a551-9a6ba396e2f7.4972.1","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","2021-02-13-18-828f8250-b337-4094-a551-9a6ba396e2f7.5104.5-fggivf-54","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","2021-02-13-18-828f8250-b337-4094-a551-9a6ba396e2f7.5104.6-fggivf-55","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.20-fggivf-11","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.23-fggivf-14","datalog.sync-status.shard.683fc559-f564-4678-9d94-a4eeda89e756.0","obj_delete_at_hint.0000000075","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4824.4-fggivf-47","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.48-fggivf-39","datalog.sync-status.shard.0309fa59-88d6-4791-9422-c40c249763c5.2.retry","data.full-sync.index.683fc559-f564-4678-9d94-a4eeda89e756.3","data.full-sync.index.683fc559-f564-4678-9d94-a4eeda89e756.2","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4824.5-fggivf-48"] 2021-02-13T18:00:25.106 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['log', 'list', '--rgw-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:25.106 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'log', 'list', '--rgw-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:25.106 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 log list --rgw-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:25.190 INFO:teuthology.orchestra.run.gibba038.stdout:["2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.3-fggivf-3","obj_delete_at_hint.0000000078","meta.history","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.28-fggivf-19","obj_delete_at_hint.0000000070","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","obj_delete_at_hint.0000000104","datalog.sync-status.shard.828f8250-b337-4094-a551-9a6ba396e2f7.0","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","meta.log.595e1dd1-4688-4d03-af39-72f8737fa57e.2","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.1-fggivf-1","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.33-fggivf-24","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-14:828f8250-b337-4094-a551-9a6ba396e2f7.4334.23","obj_delete_at_hint.0000000040","meta.full-sync.index.0","datalog.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.18-fggivf-9","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","data.full-sync.index.0309fa59-88d6-4791-9422-c40c249763c5.3","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.25-fggivf-16","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","datalog.sync-status.0309fa59-88d6-4791-9422-c40c249763c5","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4824.1-fggivf-44","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.37-fggivf-28","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4824.3-fggivf-46","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-48:828f8250-b337-4094-a551-9a6ba396e2f7.4824.5","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.2-fggivf-2","obj_delete_at_hint.0000000110","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.47-fggivf-38","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-38:828f8250-b337-4094-a551-9a6ba396e2f7.4334.47","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","bilog.trim","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-12:828f8250-b337-4094-a551-9a6ba396e2f7.4334.21","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.45-fggivf-36","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.17-fggivf-8","datalog.sync-status.shard.0309fa59-88d6-4791-9422-c40c249763c5.3.retry","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","datalog.sync-status.shard.0309fa59-88d6-4791-9422-c40c249763c5.1","obj_delete_at_hint.0000000071","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.21-fggivf-12","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-20:828f8250-b337-4094-a551-9a6ba396e2f7.4334.29","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","data_log.1","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.30-fggivf-21","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.26-fggivf-17","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","meta.full-sync.index.1","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-47:828f8250-b337-4094-a551-9a6ba396e2f7.4824.4","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-47:828f8250-b337-4094-a551-9a6ba396e2f7.4824.4","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-46:828f8250-b337-4094-a551-9a6ba396e2f7.4824.3","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-13:828f8250-b337-4094-a551-9a6ba396e2f7.4334.22","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4972.1-fggivf-49","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-10:828f8250-b337-4094-a551-9a6ba396e2f7.4334.19","mdlog.sync-status.shard.2","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.43-fggivf-34","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-14:828f8250-b337-4094-a551-9a6ba396e2f7.4334.23","obj_delete_at_hint.0000000116","datalog.sync-status.shard.0309fa59-88d6-4791-9422-c40c249763c5.0","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-15:828f8250-b337-4094-a551-9a6ba396e2f7.4334.24","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","mdlog.sync-status.shard.1","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-10:828f8250-b337-4094-a551-9a6ba396e2f7.4334.19","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.46-fggivf-37","2021-02-13-18-828f8250-b337-4094-a551-9a6ba396e2f7.5104.8-fggivf-57","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-38:828f8250-b337-4094-a551-9a6ba396e2f7.4334.47","obj_delete_at_hint.0000000066","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-12:828f8250-b337-4094-a551-9a6ba396e2f7.4334.21","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","data.full-sync.index.0309fa59-88d6-4791-9422-c40c249763c5.2","2021-02-13-17-683fc559-f564-4678-9d94-a4eeda89e756.7516.1-fggivf-42","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.24-fggivf-15","meta.full-sync.index.3","obj_delete_at_hint.0000000118","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","obj_delete_at_hint.0000000036","data.full-sync.index.0309fa59-88d6-4791-9422-c40c249763c5.0","datalog.sync-status.shard.0309fa59-88d6-4791-9422-c40c249763c5.1.retry","obj_delete_at_hint.0000000103","mdlog.sync-status.shard.3","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","data.full-sync.index.828f8250-b337-4094-a551-9a6ba396e2f7.2","mdlog.sync-status.shard.0","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.32-fggivf-23","datalog.sync-status.shard.828f8250-b337-4094-a551-9a6ba396e2f7.3","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.4-fggivf-4","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","obj_delete_at_hint.0000000039","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.19-fggivf-10","obj_delete_at_hint.0000000100","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.29-fggivf-20","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.50-fggivf-41","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.6-fggivf-6","datalog.sync-status.shard.0309fa59-88d6-4791-9422-c40c249763c5.2","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.22-fggivf-13","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4824.2-fggivf-45","obj_delete_at_hint.0000000012","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","data.full-sync.index.828f8250-b337-4094-a551-9a6ba396e2f7.3","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.40-fggivf-31","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-36:828f8250-b337-4094-a551-9a6ba396e2f7.4334.45","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-36:828f8250-b337-4094-a551-9a6ba396e2f7.4334.45","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.35-fggivf-26","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","datalog.sync-status.shard.828f8250-b337-4094-a551-9a6ba396e2f7.1.retry","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","2021-02-13-17-683fc559-f564-4678-9d94-a4eeda89e756.7516.2-fggivf-43","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","2021-02-13-18-828f8250-b337-4094-a551-9a6ba396e2f7.5104.2-fggivf-51","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-13:828f8250-b337-4094-a551-9a6ba396e2f7.4334.22","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.49-fggivf-40","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-20:828f8250-b337-4094-a551-9a6ba396e2f7.4334.29","obj_delete_at_hint.0000000108","datalog.sync-status.shard.0309fa59-88d6-4791-9422-c40c249763c5.3","obj_delete_at_hint.0000000094","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.31-fggivf-22","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-48:828f8250-b337-4094-a551-9a6ba396e2f7.4824.5","datalog.sync-status.shard.0309fa59-88d6-4791-9422-c40c249763c5.0.retry","obj_delete_at_hint.0000000051","data.full-sync.index.828f8250-b337-4094-a551-9a6ba396e2f7.1","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","meta.full-sync.index.2","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-11:828f8250-b337-4094-a551-9a6ba396e2f7.4334.20","datalog.sync-status.shard.828f8250-b337-4094-a551-9a6ba396e2f7.1","obj_delete_at_hint.0000000067","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-37:828f8250-b337-4094-a551-9a6ba396e2f7.4334.46","obj_delete_at_hint.0000000086","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.16-fggivf-7","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","datalog.sync-status.shard.828f8250-b337-4094-a551-9a6ba396e2f7.2","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.34-fggivf-25","data.full-sync.index.0309fa59-88d6-4791-9422-c40c249763c5.1","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-11:828f8250-b337-4094-a551-9a6ba396e2f7.4334.20","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.5-fggivf-5","bucket.sync-status.0309fa59-88d6-4791-9422-c40c249763c5:fggivf-49:828f8250-b337-4094-a551-9a6ba396e2f7.4972.1","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-37:828f8250-b337-4094-a551-9a6ba396e2f7.4334.46","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","2021-02-13-18-828f8250-b337-4094-a551-9a6ba396e2f7.5104.5-fggivf-54","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-49:828f8250-b337-4094-a551-9a6ba396e2f7.4972.1","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.20-fggivf-11","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.23-fggivf-14","obj_delete_at_hint.0000000075","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4824.4-fggivf-47","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-46:828f8250-b337-4094-a551-9a6ba396e2f7.4824.3","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.48-fggivf-39","datalog.sync-status.shard.0309fa59-88d6-4791-9422-c40c249763c5.2.retry","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4824.5-fggivf-48","data.full-sync.index.828f8250-b337-4094-a551-9a6ba396e2f7.0","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-15:828f8250-b337-4094-a551-9a6ba396e2f7.4334.24"] 2021-02-13T18:00:25.204 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['log', 'list', '--rgw-zone', 'test-zone3', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:25.205 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'log', 'list', '--rgw-zone', 'test-zone3', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:25.205 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 log list --rgw-zone test-zone3 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:25.327 INFO:teuthology.orchestra.run.gibba037.stdout:["2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.3-fggivf-3","obj_delete_at_hint.0000000078","meta.history","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.28-fggivf-19","obj_delete_at_hint.0000000070","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","obj_delete_at_hint.0000000104","datalog.sync-status.shard.828f8250-b337-4094-a551-9a6ba396e2f7.0","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-10:828f8250-b337-4094-a551-9a6ba396e2f7.4334.19","meta.log.595e1dd1-4688-4d03-af39-72f8737fa57e.2","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.1-fggivf-1","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.33-fggivf-24","obj_delete_at_hint.0000000040","meta.full-sync.index.0","datalog.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7","obj_delete_at_hint.0000000015","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","meta.log.efc2d01e-ebf2-4522-b313-ef15a0018fb0.0","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.18-fggivf-9","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","data.full-sync.index.683fc559-f564-4678-9d94-a4eeda89e756.0","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.25-fggivf-16","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.41-fggivf-32","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4824.1-fggivf-44","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4824.3-fggivf-46","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-37:828f8250-b337-4094-a551-9a6ba396e2f7.4334.46","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-48:828f8250-b337-4094-a551-9a6ba396e2f7.4824.5","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.2-fggivf-2","obj_delete_at_hint.0000000110","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","obj_delete_at_hint.0000000006","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-12:828f8250-b337-4094-a551-9a6ba396e2f7.4334.21","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.47-fggivf-38","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-38:828f8250-b337-4094-a551-9a6ba396e2f7.4334.47","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","bilog.trim","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-20:828f8250-b337-4094-a551-9a6ba396e2f7.4334.29","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.45-fggivf-36","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","2021-02-13-18-828f8250-b337-4094-a551-9a6ba396e2f7.5104.9-fggivf-58","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.17-fggivf-8","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","data.full-sync.index.683fc559-f564-4678-9d94-a4eeda89e756.1","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.21-fggivf-12","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-20:828f8250-b337-4094-a551-9a6ba396e2f7.4334.29","obj_delete_at_hint.0000000074","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","data_log.1","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.30-fggivf-21","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.26-fggivf-17","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","meta.full-sync.index.1","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-47:828f8250-b337-4094-a551-9a6ba396e2f7.4824.4","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-48:828f8250-b337-4094-a551-9a6ba396e2f7.4824.5","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-14:828f8250-b337-4094-a551-9a6ba396e2f7.4334.23","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-13:828f8250-b337-4094-a551-9a6ba396e2f7.4334.22","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.44-fggivf-35","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4972.1-fggivf-49","datalog.sync-status.shard.683fc559-f564-4678-9d94-a4eeda89e756.1","meta.log.3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b.2","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","mdlog.sync-status.shard.2","obj_delete_at_hint.0000000045","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-13:828f8250-b337-4094-a551-9a6ba396e2f7.4334.22","obj_delete_at_hint.0000000002","datalog.sync-status.683fc559-f564-4678-9d94-a4eeda89e756","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-14:828f8250-b337-4094-a551-9a6ba396e2f7.4334.23","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-49:828f8250-b337-4094-a551-9a6ba396e2f7.4972.1","mdlog.sync-status.shard.1","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-10:828f8250-b337-4094-a551-9a6ba396e2f7.4334.19","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.46-fggivf-37","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","meta.log.efc2d01e-ebf2-4522-b313-ef15a0018fb0.2","datalog.sync-status.shard.683fc559-f564-4678-9d94-a4eeda89e756.2","obj_delete_at_hint.0000000066","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-12:828f8250-b337-4094-a551-9a6ba396e2f7.4334.21","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.27-fggivf-18","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-11:828f8250-b337-4094-a551-9a6ba396e2f7.4334.20","2021-02-13-17-683fc559-f564-4678-9d94-a4eeda89e756.7516.1-fggivf-42","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.24-fggivf-15","meta.full-sync.index.3","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","mdlog.sync-status.shard.3","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","data.full-sync.index.828f8250-b337-4094-a551-9a6ba396e2f7.2","mdlog.sync-status.shard.0","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.32-fggivf-23","datalog.sync-status.shard.828f8250-b337-4094-a551-9a6ba396e2f7.3","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.4-fggivf-4","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","obj_delete_at_hint.0000000039","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-36:828f8250-b337-4094-a551-9a6ba396e2f7.4334.45","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.19-fggivf-10","obj_delete_at_hint.0000000100","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.29-fggivf-20","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.50-fggivf-41","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.6-fggivf-6","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-15:828f8250-b337-4094-a551-9a6ba396e2f7.4334.24","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.22-fggivf-13","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4824.2-fggivf-45","obj_delete_at_hint.0000000012","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","data.full-sync.index.828f8250-b337-4094-a551-9a6ba396e2f7.3","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.38-fggivf-29","2021-02-13-18-828f8250-b337-4094-a551-9a6ba396e2f7.5104.3-fggivf-52","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-36:828f8250-b337-4094-a551-9a6ba396e2f7.4334.45","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.35-fggivf-26","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","datalog.sync-status.shard.828f8250-b337-4094-a551-9a6ba396e2f7.1.retry","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","2021-02-13-17-683fc559-f564-4678-9d94-a4eeda89e756.7516.2-fggivf-43","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","datalog.sync-status.shard.683fc559-f564-4678-9d94-a4eeda89e756.1.retry","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.49-fggivf-40","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","datalog.sync-status.shard.683fc559-f564-4678-9d94-a4eeda89e756.3","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.31-fggivf-22","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","obj_delete_at_hint.0000000051","data.full-sync.index.828f8250-b337-4094-a551-9a6ba396e2f7.1","obj_delete_at_hint.0000000106","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-46:828f8250-b337-4094-a551-9a6ba396e2f7.4824.3","obj_delete_at_hint.0000000046","meta.full-sync.index.2","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-11:828f8250-b337-4094-a551-9a6ba396e2f7.4334.20","datalog.sync-status.shard.828f8250-b337-4094-a551-9a6ba396e2f7.1","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.16-fggivf-7","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-38:828f8250-b337-4094-a551-9a6ba396e2f7.4334.47","bucket.sync-status.683fc559-f564-4678-9d94-a4eeda89e756:fggivf-47:828f8250-b337-4094-a551-9a6ba396e2f7.4824.4","datalog.sync-status.shard.828f8250-b337-4094-a551-9a6ba396e2f7.2","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.34-fggivf-25","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.5-fggivf-5","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-37:828f8250-b337-4094-a551-9a6ba396e2f7.4334.46","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","meta.log.efc2d01e-ebf2-4522-b313-ef15a0018fb0.3","obj_delete_at_hint.0000000126","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","2021-02-13-18-828f8250-b337-4094-a551-9a6ba396e2f7.5104.6-fggivf-55","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-49:828f8250-b337-4094-a551-9a6ba396e2f7.4972.1","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.20-fggivf-11","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.23-fggivf-14","datalog.sync-status.shard.683fc559-f564-4678-9d94-a4eeda89e756.0","obj_delete_at_hint.0000000075","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4824.4-fggivf-47","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-46:828f8250-b337-4094-a551-9a6ba396e2f7.4824.3","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4334.48-fggivf-39","data.full-sync.index.683fc559-f564-4678-9d94-a4eeda89e756.3","data.full-sync.index.683fc559-f564-4678-9d94-a4eeda89e756.2","2021-02-13-17-828f8250-b337-4094-a551-9a6ba396e2f7.4824.5-fggivf-48","data.full-sync.index.828f8250-b337-4094-a551-9a6ba396e2f7.0","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-15:828f8250-b337-4094-a551-9a6ba396e2f7.4334.24"] 2021-02-13T18:00:25.348 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['log', 'list', '--rgw-zone', 'test-zone4', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:25.349 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'log', 'list', '--rgw-zone', 'test-zone4', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:25.349 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 log list --rgw-zone test-zone4 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:25.433 INFO:teuthology.orchestra.run.gibba038.stdout:["obj_delete_at_hint.0000000078","meta.history","obj_delete_at_hint.0000000070","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-17:828f8250-b337-4094-a551-9a6ba396e2f7.4334.26","obj_delete_at_hint.0000000104","datalog.sync-status.shard.828f8250-b337-4094-a551-9a6ba396e2f7.0","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","meta.log.595e1dd1-4688-4d03-af39-72f8737fa57e.2","obj_delete_at_hint.0000000040","meta.full-sync.index.0","datalog.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","meta.log.efc2d01e-ebf2-4522-b313-ef15a0018fb0.0","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-22:828f8250-b337-4094-a551-9a6ba396e2f7.4334.31","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-48:828f8250-b337-4094-a551-9a6ba396e2f7.4824.5","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-19:828f8250-b337-4094-a551-9a6ba396e2f7.4334.28","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-24:828f8250-b337-4094-a551-9a6ba396e2f7.4334.33","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-38:828f8250-b337-4094-a551-9a6ba396e2f7.4334.47","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-25:828f8250-b337-4094-a551-9a6ba396e2f7.4334.34","bilog.trim","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-20:828f8250-b337-4094-a551-9a6ba396e2f7.4334.29","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","meta.full-sync.index.1","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-47:828f8250-b337-4094-a551-9a6ba396e2f7.4824.4","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-13:828f8250-b337-4094-a551-9a6ba396e2f7.4334.22","meta.log.3346229b-3f7a-4d75-af6b-e0ad9e9e5d6b.2","mdlog.sync-status.shard.2","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-14:828f8250-b337-4094-a551-9a6ba396e2f7.4334.23","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","mdlog.sync-status.shard.1","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-10:828f8250-b337-4094-a551-9a6ba396e2f7.4334.19","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","meta.log.efc2d01e-ebf2-4522-b313-ef15a0018fb0.2","obj_delete_at_hint.0000000066","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-12:828f8250-b337-4094-a551-9a6ba396e2f7.4334.21","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","meta.full-sync.index.3","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","mdlog.sync-status.shard.3","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","data.full-sync.index.828f8250-b337-4094-a551-9a6ba396e2f7.2","mdlog.sync-status.shard.0","datalog.sync-status.shard.828f8250-b337-4094-a551-9a6ba396e2f7.3","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-23:828f8250-b337-4094-a551-9a6ba396e2f7.4334.32","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","obj_delete_at_hint.0000000012","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-21:828f8250-b337-4094-a551-9a6ba396e2f7.4334.30","data.full-sync.index.828f8250-b337-4094-a551-9a6ba396e2f7.3","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-36:828f8250-b337-4094-a551-9a6ba396e2f7.4334.45","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","datalog.sync-status.shard.828f8250-b337-4094-a551-9a6ba396e2f7.1.retry","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","data.full-sync.index.828f8250-b337-4094-a551-9a6ba396e2f7.1","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","meta.full-sync.index.2","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-11:828f8250-b337-4094-a551-9a6ba396e2f7.4334.20","datalog.sync-status.shard.828f8250-b337-4094-a551-9a6ba396e2f7.1","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","datalog.sync-status.shard.828f8250-b337-4094-a551-9a6ba396e2f7.2","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-26:828f8250-b337-4094-a551-9a6ba396e2f7.4334.35","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-37:828f8250-b337-4094-a551-9a6ba396e2f7.4334.46","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","meta.log.efc2d01e-ebf2-4522-b313-ef15a0018fb0.3","obj_delete_at_hint.0000000126","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-16:828f8250-b337-4094-a551-9a6ba396e2f7.4334.25","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-49:828f8250-b337-4094-a551-9a6ba396e2f7.4972.1","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-46:828f8250-b337-4094-a551-9a6ba396e2f7.4824.3","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030","data.full-sync.index.828f8250-b337-4094-a551-9a6ba396e2f7.0","bucket.sync-status.828f8250-b337-4094-a551-9a6ba396e2f7:fggivf-15:828f8250-b337-4094-a551-9a6ba396e2f7.4334.24"] 2021-02-13T18:00:25.528 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:25.528 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:25.528 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:25.613 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"1_1613239224.962156_333.1","last_update":"2021-02-13 18:00:24.962156Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:00:25.614 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-02-13T18:00:25.614 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:25.614 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:25.614 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:25.707 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12498329254734520252},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613239090.916510_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:58:10.916510Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:00:25.708 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=1 master=1_1613239224.962156_333.1 target=1_1613239090.916510_246.1 2021-02-13T18:00:30.709 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:30.709 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:30.710 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:30.802 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12498329254734520252},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613239090.916510_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:58:10.916510Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:00:30.803 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=1 master=1_1613239224.962156_333.1 target=1_1613239090.916510_246.1 2021-02-13T18:00:35.804 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:35.805 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:35.805 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:35.891 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12498329254734520252},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613239090.916510_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:58:10.916510Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:00:35.891 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=1 master=1_1613239224.962156_333.1 target=1_1613239090.916510_246.1 2021-02-13T18:00:40.892 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:40.893 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:40.893 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:40.978 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12498329254734520252},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613239090.916510_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:58:10.916510Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:00:40.979 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=1 master=1_1613239224.962156_333.1 target=1_1613239090.916510_246.1 2021-02-13T18:00:45.980 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:45.980 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:45.980 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:46.070 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12498329254734520252},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613239090.916510_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:58:10.916510Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:00:46.071 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=1 master=1_1613239224.962156_333.1 target=1_1613239090.916510_246.1 2021-02-13T18:00:51.071 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:51.072 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:51.072 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:51.166 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12498329254734520252},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613239090.916510_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:58:10.916510Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:00:51.167 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=1 master=1_1613239224.962156_333.1 target=1_1613239090.916510_246.1 2021-02-13T18:00:56.169 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:56.169 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:56.169 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:56.264 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12498329254734520252},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613239090.916510_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:58:10.916510Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:00:56.265 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=1 master=1_1613239224.962156_333.1 target=1_1613239090.916510_246.1 2021-02-13T18:01:01.266 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:01.266 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:01.266 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:01.356 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12498329254734520252},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613239090.916510_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:58:10.916510Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:01:01.356 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=1 master=1_1613239224.962156_333.1 target=1_1613239090.916510_246.1 2021-02-13T18:01:06.357 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:06.357 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:06.357 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:06.482 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12498329254734520252},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613239090.916510_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:58:10.916510Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:01:06.482 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=1 master=1_1613239224.962156_333.1 target=1_1613239090.916510_246.1 2021-02-13T18:01:11.483 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:11.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:11.483 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:11.574 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12498329254734520252},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613239090.916510_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:58:10.916510Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:01:11.574 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=1 master=1_1613239224.962156_333.1 target=1_1613239090.916510_246.1 2021-02-13T18:01:16.575 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:16.575 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:16.575 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:16.669 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12498329254734520252},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613239090.916510_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:58:10.916510Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:01:16.669 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=1 master=1_1613239224.962156_333.1 target=1_1613239090.916510_246.1 2021-02-13T18:01:21.670 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:21.670 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:21.670 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:21.759 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12498329254734520252},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613239090.916510_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:58:10.916510Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:01:21.760 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=1 master=1_1613239224.962156_333.1 target=1_1613239090.916510_246.1 2021-02-13T18:01:26.760 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:26.761 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:26.761 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:26.846 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12498329254734520252},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613239224.962156_333.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:00:24.962156Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:01:26.847 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-02-13T18:01:26.847 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:26.847 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:26.847 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:26.925 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"1_1613239224.962156_333.1","last_update":"2021-02-13 18:00:24.962156Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:01:26.926 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-02-13T18:01:26.926 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:26.926 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:26.926 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:27.010 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12489312529549451383},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613239224.962156_333.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:00:24.962156Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:01:27.010 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-02-13T18:01:27.011 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:27.011 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:27.011 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:27.084 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"1_1613239224.962156_333.1","last_update":"2021-02-13 18:00:24.962156Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:01:27.084 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone4 source_zone=test-zone1 2021-02-13T18:01:27.084 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:27.084 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:27.085 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:27.302 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":7615325546547900322},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613239224.962156_333.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:00:24.962156Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:01:27.302 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone4 source_zone=test-zone1 2021-02-13T18:01:27.303 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:27.303 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:27.303 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:27.394 INFO:teuthology.orchestra.run.gibba038.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"1_1613239115.547870_243.1","last_update":"2021-02-13 17:58:35.547870Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:01:27.395 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-02-13T18:01:27.395 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:27.395 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:27.395 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:27.479 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12876143478402394807},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613239115.547870_243.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:58:35.547870Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:01:27.479 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-02-13T18:01:27.479 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:27.480 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:27.480 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:27.602 INFO:teuthology.orchestra.run.gibba038.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"1_1613239115.547870_243.1","last_update":"2021-02-13 17:58:35.547870Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:01:27.603 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone2 2021-02-13T18:01:27.603 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:27.603 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:27.603 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:27.683 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":13320372316851528683},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1613239115.547870_243.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:58:35.547870Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:01:27.684 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone2 2021-02-13T18:01:27.684 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:27.684 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:27.685 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:27.758 INFO:teuthology.orchestra.run.gibba038.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"1_1613239115.547870_243.1","last_update":"2021-02-13 17:58:35.547870Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:01:27.758 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone4 source_zone=test-zone2 2021-02-13T18:01:27.759 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:27.759 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:27.759 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:27.943 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:01:27.943 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:01:32.944 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:32.945 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:32.945 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:33.128 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:01:33.129 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:01:38.130 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:38.130 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:38.131 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:38.314 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:01:38.315 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:01:43.316 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:43.316 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:43.316 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:43.494 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:01:43.494 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:01:48.496 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:48.496 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:48.496 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:48.716 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:01:48.717 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:01:53.717 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:53.717 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:53.718 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:53.901 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:01:53.902 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:01:58.903 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:58.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:58.904 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:59.081 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:01:59.082 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:02:04.083 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:04.083 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:04.084 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:04.268 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:02:04.268 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:02:09.270 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:09.270 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:09.270 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:09.455 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:02:09.456 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:02:14.456 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:14.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:14.457 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:14.642 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:02:14.643 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:02:19.644 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:19.644 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:19.645 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:19.828 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:02:19.829 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:02:24.830 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:24.830 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:24.831 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:25.013 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:02:25.014 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:02:30.015 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:30.015 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:30.015 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:30.191 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:02:30.191 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:02:35.192 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:35.193 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:35.193 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:35.379 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:02:35.380 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:02:40.381 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:40.381 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:40.381 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:40.567 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:02:40.568 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:02:45.568 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:45.568 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:45.569 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:45.752 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:02:45.753 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:02:50.754 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:50.754 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:50.754 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:50.938 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:02:50.939 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:02:55.940 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:55.941 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:55.941 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:56.120 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:02:56.120 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:03:01.121 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:01.121 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:01.122 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:01.307 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:03:01.307 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:03:06.308 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:06.309 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:06.309 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:06.493 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:03:06.493 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:03:11.494 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:11.495 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:11.495 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:11.676 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:03:11.676 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:03:16.677 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:16.677 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:16.678 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:16.858 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:03:16.858 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:03:21.859 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:21.860 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:21.860 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:22.033 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:03:22.034 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:03:27.035 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:27.035 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:27.035 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:27.213 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:03:27.213 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:03:32.214 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:32.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:32.215 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:32.391 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:03:32.391 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:03:37.392 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:37.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:37.392 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:37.578 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:03:37.578 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:03:42.579 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:42.579 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:42.580 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:42.763 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:03:42.764 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:03:47.764 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:47.765 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:47.765 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:47.950 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:03:47.951 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:03:52.951 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:52.952 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:52.952 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:53.123 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:03:53.123 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:03:58.124 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:58.125 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:58.125 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:58.311 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:03:58.311 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:04:03.312 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:03.312 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:03.312 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:03.490 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:04:03.490 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:04:08.491 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:08.491 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:08.491 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:08.670 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:04:08.671 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:04:13.672 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:13.672 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:13.673 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:13.852 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:04:13.853 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:04:18.854 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:18.854 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:18.855 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:19.041 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:04:19.041 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:04:24.042 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:24.042 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:24.042 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:24.215 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:04:24.215 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:04:29.216 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:29.217 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:29.217 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:29.395 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:04:29.395 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:04:34.396 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:34.397 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:34.397 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:34.574 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:04:34.575 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:04:39.575 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:39.576 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:39.576 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:39.762 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:04:39.762 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:04:44.763 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:44.763 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:44.764 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:44.941 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:04:44.941 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:04:49.942 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:49.942 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:49.942 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:50.128 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:04:50.128 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:04:55.129 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:55.129 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:55.130 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:55.307 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:04:55.308 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:05:00.309 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:00.309 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:00.309 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:00.495 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:05:00.495 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:05:05.496 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:05.496 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:05.497 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:05.675 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:05:05.676 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:05:10.676 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:10.677 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:10.677 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:10.855 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:05:10.856 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:05:15.857 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:15.857 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:15.857 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:16.040 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:05:16.041 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:05:21.042 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:21.042 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:21.042 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:21.221 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:05:21.222 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:05:26.223 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:26.223 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:26.223 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:26.401 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:05:26.401 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:05:31.402 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:31.402 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:31.403 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:31.581 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:05:31.581 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:05:36.582 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:36.583 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:36.583 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:36.770 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:05:36.771 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:05:41.771 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:41.772 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:41.772 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:41.950 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:05:41.950 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:05:46.951 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:46.951 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:46.952 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:47.132 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:05:47.133 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:05:52.134 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:52.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:52.135 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:52.316 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:05:52.316 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:05:57.317 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:57.318 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:57.318 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:57.494 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:05:57.495 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:06:02.495 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:02.496 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:02.496 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:02.681 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:06:02.682 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:06:07.683 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:07.683 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:07.684 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:07.862 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:06:07.863 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:06:12.863 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:12.864 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:12.864 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:13.045 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:06:13.046 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:06:18.046 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:18.046 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:18.046 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:18.233 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:06:18.233 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:06:23.234 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:23.234 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:23.235 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:23.413 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:06:23.414 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:06:28.414 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:28.414 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:28.415 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:28.592 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:06:28.592 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:06:33.593 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:33.594 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:33.594 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:33.773 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:06:33.773 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:06:38.776 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_sync_disable ... FAIL 2021-02-13T18:06:38.776 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-59 2021-02-13T18:06:38.841 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-60 2021-02-13T18:06:38.944 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=fggivf-61 2021-02-13T18:06:39.639 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:39.639 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:39.639 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-59 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:39.760 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000008.32.5"}]} 2021-02-13T18:06:39.761 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-59 2021-02-13T18:06:39.761 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:39.761 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:39.761 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:39.829 INFO:teuthology.orchestra.run.gibba038.stderr:could not get bucket info for bucket=fggivf-59 2021-02-13T18:06:39.830 INFO:teuthology.orchestra.run.gibba038.stderr:ERROR: could not init bucket: (2) No such file or directory 2021-02-13T18:06:39.842 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-02-13T18:06:39.842 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:39.842 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:39.843 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:39.909 INFO:teuthology.orchestra.run.gibba038.stderr:could not get bucket info for bucket=2021-02-13 18:06:39.902 7ffa00f07940 -1 ERROR: get_bucket_instance_from_oid failed: -2fggivf-59 2021-02-13T18:06:39.909 INFO:teuthology.orchestra.run.gibba038.stderr: 2021-02-13T18:06:39.909 INFO:teuthology.orchestra.run.gibba038.stderr:ERROR: could not init bucket: (2) No such file or directory 2021-02-13T18:06:39.922 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-02-13T18:06:39.923 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:39.923 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:39.923 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:40.004 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:06:40.005 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone2 behind zone test-zone1: shard=0 master=00000000008.32.5 target= 2021-02-13T18:06:45.006 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:45.006 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:45.007 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:45.099 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.32.5"}}}] 2021-02-13T18:06:45.099 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-59 2021-02-13T18:06:45.099 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:45.099 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:45.099 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-59 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:45.189 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000008.32.5"}]} 2021-02-13T18:06:45.189 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-59 2021-02-13T18:06:45.189 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:45.189 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:45.189 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-59 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:45.276 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.32.5"}}}] 2021-02-13T18:06:45.277 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-59 2021-02-13T18:06:45.277 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:45.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:45.277 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-59 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:45.367 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000008.32.5"}]} 2021-02-13T18:06:45.367 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-59 2021-02-13T18:06:45.367 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:45.367 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:45.367 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:45.545 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.32.5"}}}] 2021-02-13T18:06:45.546 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-59 2021-02-13T18:06:45.546 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:45.546 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:45.546 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:45.666 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000008.31.5"}]} 2021-02-13T18:06:45.666 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-59 2021-02-13T18:06:45.666 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:45.667 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:45.667 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:45.750 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.31.5"}}}] 2021-02-13T18:06:45.751 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-59 2021-02-13T18:06:45.751 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:45.751 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:45.751 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:45.873 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000008.31.5"}]} 2021-02-13T18:06:45.874 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-59 2021-02-13T18:06:45.874 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:45.874 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:45.875 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:45.965 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.31.5"}}}] 2021-02-13T18:06:45.966 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-59 2021-02-13T18:06:45.966 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:45.966 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:45.966 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:46.054 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000008.31.5"}]} 2021-02-13T18:06:46.055 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-59 2021-02-13T18:06:46.055 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:46.055 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:46.055 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:46.236 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:06:46.237 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:06:51.238 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:51.238 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:51.238 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:51.419 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:06:51.419 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:06:56.419 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:56.420 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:56.420 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:56.601 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:06:56.602 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:07:01.602 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:01.602 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:01.603 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:01.779 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:01.780 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:07:06.781 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:06.781 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:06.781 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:06.962 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:06.963 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:07:11.963 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:11.964 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:11.964 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:12.147 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:12.147 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:07:17.148 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:17.149 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:17.149 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:17.334 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:17.335 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:07:22.336 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:22.336 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:22.336 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:22.515 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:22.515 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:07:27.516 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:27.517 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:27.517 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:27.703 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:27.703 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:07:32.704 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:32.704 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:32.705 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:32.886 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:32.887 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:07:37.888 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:37.888 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:37.888 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:38.072 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:38.072 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:07:43.074 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:43.074 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:43.074 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:43.262 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:43.262 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:07:48.263 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:48.263 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:48.263 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:48.441 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:48.442 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:07:53.443 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:53.443 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:53.443 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:53.627 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:53.627 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:07:58.628 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:58.629 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:58.629 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:58.807 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:58.808 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:08:03.809 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:03.809 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:03.809 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:03.995 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:03.996 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:08:08.997 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:08.997 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:08.997 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:09.181 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:09.182 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:08:14.183 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:14.183 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:14.183 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:14.372 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:14.372 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:08:19.373 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:19.373 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:19.373 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:19.554 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:19.554 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:08:24.555 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:24.555 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:24.556 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:24.775 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:24.776 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:08:29.777 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:29.777 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:29.778 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:29.962 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:29.962 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:08:34.963 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:34.963 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:34.964 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:35.144 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:35.144 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:08:40.145 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:40.145 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:40.145 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:40.330 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:40.331 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:08:45.332 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:45.332 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:45.332 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:45.520 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:45.520 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:08:50.521 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:50.521 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:50.521 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:50.701 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:50.701 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:08:55.701 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:55.702 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:55.702 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:55.884 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:55.884 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:09:00.884 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:00.885 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:00.885 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:01.072 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:01.072 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:09:06.073 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:06.073 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:06.073 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:06.259 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:06.260 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:09:11.261 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:11.261 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:11.261 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:11.448 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:11.448 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:09:16.449 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:16.450 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:16.450 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:16.634 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:16.634 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:09:21.635 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:21.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:21.636 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:21.814 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:21.814 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:09:26.815 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:26.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:26.815 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:26.999 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:26.999 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:09:32.000 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:32.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:32.001 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:32.189 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:32.190 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:09:37.191 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:37.191 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:37.191 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:37.377 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:37.378 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:09:42.378 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:42.378 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:42.379 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:42.562 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:42.562 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:09:47.563 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:47.563 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:47.564 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:47.737 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:47.737 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:09:52.738 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:52.739 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:52.739 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:52.924 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:52.925 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:09:57.926 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:57.926 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:57.927 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:58.106 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:58.107 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:10:03.108 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:03.108 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:03.108 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:03.287 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:03.288 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:10:08.289 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:08.289 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:08.289 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:08.469 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:08.470 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:10:13.470 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:13.471 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:13.471 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:13.656 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:13.658 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:10:18.659 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:18.659 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:18.660 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:18.841 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:18.841 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:10:23.841 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:23.842 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:23.842 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:24.014 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:24.014 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:10:29.015 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:29.015 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:29.016 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:29.201 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:29.202 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:10:34.203 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:34.203 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:34.203 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:34.384 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:34.384 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:10:39.386 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:39.386 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:39.386 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:39.576 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:39.576 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:10:44.577 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:44.577 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:44.577 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:44.760 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:44.761 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:10:49.762 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:49.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:49.762 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:49.948 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:49.948 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:10:54.949 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:54.949 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:54.950 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:55.130 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:55.130 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:11:00.131 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:00.132 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:00.132 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:00.308 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:00.309 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:11:05.309 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:05.310 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:05.310 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:05.493 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:05.494 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:11:10.495 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:10.495 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:10.495 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:10.675 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:10.676 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:11:15.676 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:15.676 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:15.677 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:15.856 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:15.856 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:11:20.858 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:20.858 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:20.858 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:21.036 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:21.036 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:11:26.038 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:26.038 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:26.038 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:26.218 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:26.218 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:11:31.219 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:31.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:31.220 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:31.406 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:31.407 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:11:36.408 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:36.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:36.409 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:36.596 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:36.596 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:11:41.597 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:41.598 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:41.598 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:41.787 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:41.787 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:11:46.787 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:46.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:46.788 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:46.973 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:46.973 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:11:51.974 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:51.974 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:51.974 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:52.159 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:52.159 WARNING:rgw_multi.tests:bucket fggivf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.31.5 target= 2021-02-13T18:11:57.161 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_sync_enable_right_after_disable ... FAIL 2021-02-13T18:11:57.162 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-62 2021-02-13T18:11:57.230 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-63 2021-02-13T18:11:57.333 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=fggivf-64 2021-02-13T18:11:58.015 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:58.015 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:58.015 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:58.119 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:11:58.135 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613239917.391674_194.1","last_update":"2021-02-13 18:11:57.391674Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:11:58.135 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:11:58.135 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:58.135 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:58.136 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:58.222 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613239599.000746_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:06:39.000746Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:11:58.223 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613239917.391674_194.1 target=1_1613239599.000746_178.1 2021-02-13T18:12:03.223 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:03.223 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:03.224 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:03.302 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613239917.391674_194.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:11:57.391674Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:12:03.302 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:12:03.302 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:12:03.302 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:03.303 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:03.303 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:03.387 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613239917.391674_194.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:11:57.391674Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:12:03.388 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:12:03.388 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:12:03.388 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:03.388 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:03.388 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:03.568 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613239917.391674_194.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:11:57.391674Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:12:03.569 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:12:03.569 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:03.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:03.569 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-62 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:03.658 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000008.10.5"}]} 2021-02-13T18:12:03.659 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-62 2021-02-13T18:12:03.659 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:03.659 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:03.659 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:03.789 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.10.5"}}}] 2021-02-13T18:12:03.790 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-62 2021-02-13T18:12:03.790 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:03.790 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:03.790 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-62 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:03.876 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000008.10.5"}]} 2021-02-13T18:12:03.877 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-62 2021-02-13T18:12:03.877 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:03.877 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:03.877 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-62 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:03.955 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.10.5"}}}] 2021-02-13T18:12:03.956 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-62 2021-02-13T18:12:03.956 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:03.956 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:03.956 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-62 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:04.048 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000008.10.5"}]} 2021-02-13T18:12:04.048 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-62 2021-02-13T18:12:04.048 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:04.048 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:04.048 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:04.267 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.10.5"}}}] 2021-02-13T18:12:04.267 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-62 2021-02-13T18:12:04.267 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:04.267 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:04.268 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:04.347 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000008.11.5"}]} 2021-02-13T18:12:04.348 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-62 2021-02-13T18:12:04.348 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:04.348 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:04.348 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:04.433 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.11.5"}}}] 2021-02-13T18:12:04.433 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-62 2021-02-13T18:12:04.434 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:04.434 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:04.434 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:04.558 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000008.11.5"}]} 2021-02-13T18:12:04.559 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-62 2021-02-13T18:12:04.559 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:04.559 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:04.560 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:04.688 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.11.5"}}}] 2021-02-13T18:12:04.688 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-62 2021-02-13T18:12:04.689 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:04.689 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:04.689 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:04.774 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000008.11.5"}]} 2021-02-13T18:12:04.774 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-62 2021-02-13T18:12:04.775 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:04.775 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:04.775 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:04.950 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:04.950 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:12:09.951 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:09.951 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:09.952 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:10.137 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:10.137 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:12:15.138 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:15.138 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:15.138 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:15.323 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:15.324 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:12:20.324 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:20.325 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:20.325 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:20.505 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:20.505 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:12:25.506 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:25.507 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:25.507 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:25.691 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:25.692 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:12:30.693 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:30.693 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:30.694 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:30.881 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:30.882 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:12:35.882 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:35.882 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:35.882 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:36.061 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:36.061 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:12:41.062 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:41.062 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:41.063 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:41.244 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:41.244 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:12:46.246 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:46.246 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:46.246 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:46.425 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:46.426 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:12:51.427 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:51.427 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:51.428 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:51.615 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:51.615 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:12:56.616 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:56.616 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:56.617 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:56.803 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:56.803 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:13:01.804 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:01.804 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:01.805 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:01.989 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:01.989 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:13:06.991 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:06.991 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:06.991 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:07.175 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:07.176 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:13:12.177 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:12.177 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:12.177 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:12.363 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:12.364 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:13:17.365 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:17.365 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:17.365 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:17.543 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:17.544 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:13:22.545 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:22.545 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:22.545 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:22.725 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:22.726 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:13:27.727 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:27.727 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:27.727 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:27.908 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:27.908 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:13:32.909 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:32.910 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:32.910 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:33.088 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:33.088 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:13:38.090 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:38.090 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:38.090 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:38.271 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:38.272 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:13:43.273 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:43.273 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:43.273 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:43.450 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:43.451 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:13:48.452 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:48.452 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:48.452 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:48.637 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:48.637 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:13:53.639 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:53.639 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:53.639 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:53.828 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:53.828 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:13:58.830 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:58.830 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:58.830 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:59.017 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:59.017 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:14:04.018 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:04.018 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:04.019 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:04.204 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:04.204 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:14:09.205 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:09.205 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:09.206 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:09.387 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:09.387 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:14:14.388 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:14.389 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:14.389 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:14.576 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:14.576 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:14:19.578 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:19.578 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:19.578 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:19.763 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:19.764 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:14:24.764 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:24.764 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:24.765 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:24.986 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:24.986 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:14:29.987 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:29.988 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:29.988 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:30.174 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:30.175 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:14:35.176 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:35.176 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:35.176 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:35.363 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:35.363 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:14:40.364 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:40.365 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:40.365 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:40.549 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:40.549 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:14:45.550 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:45.551 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:45.551 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:45.733 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:45.734 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:14:50.735 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:50.735 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:50.735 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:50.921 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:50.922 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:14:55.923 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:55.923 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:55.923 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:56.102 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:56.103 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:15:01.103 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:01.114 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:01.114 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:01.294 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:01.294 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:15:06.295 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:06.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:06.295 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:06.481 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:06.481 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:15:11.482 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:11.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:11.483 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:11.666 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:11.666 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:15:16.667 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:16.667 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:16.668 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:16.847 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:16.847 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:15:21.847 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:21.848 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:21.848 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:22.028 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:22.028 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:15:27.030 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:27.030 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:27.030 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:27.208 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:27.208 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:15:32.209 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:32.210 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:32.210 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:32.391 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:32.392 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:15:37.392 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:37.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:37.393 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:37.579 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:37.579 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:15:42.580 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:42.580 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:42.581 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:42.768 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:42.768 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:15:47.769 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:47.769 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:47.770 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:47.950 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:47.951 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:15:52.952 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:52.952 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:52.952 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:53.139 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:53.139 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:15:58.141 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:58.141 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:58.141 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:58.329 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:58.329 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:16:03.330 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:03.330 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:03.331 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:03.512 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:03.512 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:16:08.513 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:08.513 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:08.513 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:08.698 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:08.698 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:16:13.699 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:13.699 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:13.700 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:13.882 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:13.882 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:16:18.883 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:18.884 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:18.884 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:19.063 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:19.064 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:16:24.064 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:24.065 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:24.065 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:24.246 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:24.247 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:16:29.248 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:29.248 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:29.249 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:29.437 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:29.437 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:16:34.437 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:34.438 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:34.438 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:34.627 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:34.627 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:16:39.628 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:39.629 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:39.629 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:39.810 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:39.811 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:16:44.812 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:44.812 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:44.813 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:44.997 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:44.998 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:16:49.999 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:49.999 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:49.999 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:50.180 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:50.180 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:16:55.181 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:55.181 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:55.181 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:55.369 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:55.370 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:17:00.371 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:00.371 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:00.371 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:00.556 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:00.556 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:17:05.557 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:05.557 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:05.558 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:05.745 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:05.745 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:17:10.746 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:10.746 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:10.747 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:10.928 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:10.928 WARNING:rgw_multi.tests:bucket fggivf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.11.5 target= 2021-02-13T18:17:15.930 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_sync_disable_enable ... FAIL 2021-02-13T18:17:15.931 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-65 2021-02-13T18:17:16.008 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=fggivf-66 2021-02-13T18:17:16.121 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=fggivf-67 2021-02-13T18:17:18.675 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:18.675 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:18.675 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-65 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:18.790 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000018.23.5"}]} 2021-02-13T18:17:18.791 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-65 2021-02-13T18:17:18.791 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:18.791 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:18.791 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:18.885 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:18.885 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone2 behind zone test-zone1: shard=0 master=00000000018.23.5 target= 2021-02-13T18:17:23.886 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:23.886 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:23.886 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:23.974 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"MULTIPART","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000018.23.5"}}}] 2021-02-13T18:17:23.975 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-65 2021-02-13T18:17:23.975 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:23.975 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:23.975 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-65 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:24.057 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000018.23.5"}]} 2021-02-13T18:17:24.057 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-65 2021-02-13T18:17:24.057 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:24.058 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:24.058 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-65 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:24.134 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"MULTIPART","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000018.23.5"}}}] 2021-02-13T18:17:24.135 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-65 2021-02-13T18:17:24.135 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:24.135 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:24.135 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-65 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:24.207 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000018.23.5"}]} 2021-02-13T18:17:24.208 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-65 2021-02-13T18:17:24.208 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:24.208 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:24.208 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:24.392 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"MULTIPART","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000018.23.5"}}}] 2021-02-13T18:17:24.392 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-65 2021-02-13T18:17:24.393 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:24.393 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:24.393 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:24.482 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000002.12.5"}]} 2021-02-13T18:17:24.482 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-65 2021-02-13T18:17:24.482 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:24.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:24.483 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:24.576 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"MULTIPART","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.12.5"}}}] 2021-02-13T18:17:24.576 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-65 2021-02-13T18:17:24.576 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:24.576 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:24.577 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:24.698 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000002.12.5"}]} 2021-02-13T18:17:24.698 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-65 2021-02-13T18:17:24.698 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:24.698 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:24.699 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:24.822 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"MULTIPART","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.12.5"}}}] 2021-02-13T18:17:24.823 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-65 2021-02-13T18:17:24.823 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:24.823 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:24.823 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:24.948 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000002.12.5"}]} 2021-02-13T18:17:24.948 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-65 2021-02-13T18:17:24.948 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:24.948 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:24.949 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:25.127 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:25.128 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:17:30.128 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:30.129 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:30.129 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:30.312 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:30.312 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:17:35.313 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:35.313 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:35.313 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:35.501 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:35.502 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:17:40.503 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:40.503 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:40.504 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:40.684 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:40.684 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:17:45.685 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:45.685 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:45.685 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:45.872 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:45.873 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:17:50.873 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:50.874 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:50.874 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:51.059 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:51.059 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:17:56.059 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:56.060 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:56.060 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:56.247 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:56.248 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:18:01.249 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:01.249 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:01.249 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:01.429 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:01.430 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:18:06.431 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:06.431 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:06.431 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:06.620 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:06.621 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:18:11.622 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:11.622 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:11.622 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:11.806 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:11.806 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:18:16.807 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:16.807 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:16.807 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:16.989 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:16.989 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:18:21.990 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:21.991 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:21.991 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:22.172 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:22.172 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:18:27.173 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:27.173 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:27.174 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:27.357 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:27.357 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:18:32.358 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:32.358 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:32.359 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:32.546 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:32.546 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:18:37.547 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:37.547 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:37.548 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:37.729 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:37.729 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:18:42.730 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:42.731 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:42.731 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:42.913 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:42.913 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:18:47.914 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:47.914 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:47.914 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:48.100 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:48.100 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:18:53.101 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:53.101 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:53.102 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:53.284 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:53.284 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:18:58.285 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:58.285 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:58.285 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:58.472 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:58.472 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:19:03.473 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:03.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:03.474 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:03.658 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:03.659 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:19:08.660 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:08.660 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:08.660 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:08.847 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:08.847 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:19:13.848 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:13.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:13.849 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:14.028 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:14.028 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:19:19.029 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:19.029 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:19.030 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:19.211 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:19.211 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:19:24.212 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:24.212 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:24.212 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:24.392 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:24.392 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:19:29.393 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:29.393 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:29.394 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:29.582 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:29.583 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:19:34.584 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:34.584 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:34.585 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:34.769 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:34.769 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:19:39.770 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:39.771 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:39.771 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:39.959 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:39.959 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:19:44.961 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:44.961 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:44.961 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:45.141 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:45.142 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:19:50.142 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:50.143 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:50.143 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:50.324 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:50.324 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:19:55.325 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:55.325 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:55.325 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:55.511 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:55.511 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:20:00.512 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:00.512 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:00.513 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:00.701 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:00.701 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:20:05.702 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:05.703 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:05.703 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:05.890 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:05.890 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:20:10.892 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:10.892 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:10.892 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:11.080 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:11.080 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:20:16.082 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:16.082 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:16.082 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:16.269 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:16.270 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:20:21.270 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:21.271 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:21.271 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:21.454 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:21.454 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:20:26.456 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:26.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:26.456 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:26.640 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:26.641 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:20:31.642 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:31.642 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:31.642 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:31.824 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:31.824 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:20:36.824 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:36.825 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:36.825 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:37.007 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:37.007 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:20:42.008 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:42.008 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:42.009 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:42.195 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:42.195 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:20:47.197 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:47.197 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:47.197 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:47.385 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:47.386 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:20:52.387 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:52.387 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:52.387 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:52.574 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:52.575 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:20:57.576 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:57.576 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:57.577 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:57.766 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:57.766 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:21:02.767 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:02.767 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:02.768 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:02.948 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:02.948 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:21:07.949 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:07.950 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:07.950 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:08.130 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:08.131 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:21:13.131 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:13.132 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:13.132 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:13.322 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:13.322 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:21:18.323 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:18.324 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:18.324 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:18.508 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:18.508 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:21:23.509 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:23.510 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:23.510 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:23.697 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:23.697 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:21:28.698 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:28.698 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:28.699 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:28.885 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:28.885 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:21:33.887 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:33.887 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:33.887 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:34.075 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:34.076 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:21:39.077 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:39.077 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:39.078 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:39.265 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:39.266 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:21:44.267 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:44.267 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:44.268 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:44.449 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:44.450 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:21:49.451 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:49.451 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:49.451 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:49.632 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:49.632 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:21:54.633 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:54.633 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:54.634 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:54.813 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:54.814 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:21:59.815 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:59.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:59.815 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:00.003 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:00.004 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:22:05.004 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:05.005 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:05.005 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:05.191 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:05.192 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:22:10.192 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:10.192 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:10.193 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:10.377 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:10.377 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:22:15.377 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:15.378 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:15.378 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:15.565 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:15.566 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:22:20.567 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:20.567 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:20.567 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:20.755 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:20.755 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:22:25.756 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:25.756 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:25.757 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:25.937 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:25.937 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:22:30.938 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:30.938 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:30.938 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:31.124 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:31.124 WARNING:rgw_multi.tests:bucket fggivf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.12.5 target= 2021-02-13T18:22:36.126 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_multipart_object_sync ... FAIL 2021-02-13T18:22:36.127 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-68 2021-02-13T18:22:36.283 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:36.283 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:36.283 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:36.387 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:22:36.404 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240556.179111_214.1","last_update":"2021-02-13 18:22:36.179111Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:22:36.404 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:22:36.404 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:36.404 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:36.404 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:36.483 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240236.188830_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:17:16.188830Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:22:36.483 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613240556.179111_214.1 target=1_1613240236.188830_206.1 2021-02-13T18:22:41.484 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:41.485 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:41.485 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:41.566 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240556.179111_214.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:22:36.179111Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:22:41.566 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:22:41.567 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:22:41.567 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:41.567 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:41.567 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:41.652 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240556.179111_214.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:22:36.179111Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:22:41.653 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:22:41.653 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:22:41.653 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:41.654 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:41.654 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:41.870 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240556.179111_214.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:22:36.179111Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:22:41.871 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:22:41.871 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-68', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:41.871 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-68', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:41.871 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-68 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:41.994 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000004.15.5"}]} 2021-02-13T18:22:41.994 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-68 2021-02-13T18:22:41.995 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-68', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:41.995 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-68', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:41.995 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-68 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:42.088 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"testobj-sse-kms","instance":"","ns":""},"count":2},"inc_marker":{"position":"0#00000000004.15.5"}}}] 2021-02-13T18:22:42.088 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-68 2021-02-13T18:22:42.190 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_encrypted_object_sync ... ok 2021-02-13T18:22:42.191 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=fggivf-69 2021-02-13T18:22:42.454 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:42.455 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:42.455 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:42.555 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:22:42.571 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240562.240360_224.1","last_update":"2021-02-13 18:22:42.240360Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:22:42.571 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:22:42.571 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:42.571 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:42.571 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:42.693 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240562.240360_224.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:22:42.240360Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:22:42.693 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:22:42.694 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:22:42.694 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:42.694 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:42.694 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:42.811 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240556.179111_214.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:22:36.179111Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:22:42.812 WARNING:rgw_multi.tests:zone test-zone3 behind master: shard=2 master=1_1613240562.240360_224.1 target=1_1613240556.179111_214.1 2021-02-13T18:22:47.813 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:47.813 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:47.813 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:47.893 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240562.240360_224.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:22:42.240360Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:22:47.893 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:22:47.893 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:22:47.893 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:47.893 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:47.894 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:48.076 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240562.240360_224.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:22:42.240360Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:22:48.077 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:22:48.077 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:48.077 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:48.077 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-69 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:48.157 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000008.21.5"}]} 2021-02-13T18:22:48.158 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-69 2021-02-13T18:22:48.158 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:48.158 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:48.158 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:48.283 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.21.5"}}}] 2021-02-13T18:22:48.283 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-69 2021-02-13T18:22:48.283 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:48.283 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:48.283 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-69 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:48.403 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000008.21.5"}]} 2021-02-13T18:22:48.403 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-69 2021-02-13T18:22:48.403 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:48.404 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:48.404 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-69 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:48.480 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.21.5"}}}] 2021-02-13T18:22:48.481 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-69 2021-02-13T18:22:48.481 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:48.481 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:48.481 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-69 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:48.571 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000008.21.5"}]} 2021-02-13T18:22:48.571 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-69 2021-02-13T18:22:48.571 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:48.571 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:48.572 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:48.756 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.21.5"}}}] 2021-02-13T18:22:48.757 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-69 2021-02-13T18:22:48.757 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:48.757 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:48.757 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:48.881 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000008.19.5"}]} 2021-02-13T18:22:48.882 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-69 2021-02-13T18:22:48.882 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:48.882 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:48.882 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:48.968 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.19.5"}}}] 2021-02-13T18:22:48.969 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-69 2021-02-13T18:22:48.969 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:48.969 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:48.969 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:49.052 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000008.19.5"}]} 2021-02-13T18:22:49.053 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-69 2021-02-13T18:22:49.053 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:49.053 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:49.053 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:49.181 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.19.5"}}}] 2021-02-13T18:22:49.182 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-69 2021-02-13T18:22:49.182 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:49.182 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:49.182 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:49.270 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000008.19.5"}]} 2021-02-13T18:22:49.271 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-69 2021-02-13T18:22:49.271 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:49.271 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:49.271 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:49.459 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:49.460 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:22:54.461 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:54.461 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:54.462 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:54.650 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:54.650 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:22:59.652 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:59.652 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:59.652 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:59.831 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:59.832 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:23:04.833 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:04.833 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:04.833 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:05.018 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:05.018 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:23:10.019 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:10.020 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:10.020 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:10.197 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:10.197 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:23:15.198 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:15.198 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:15.198 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:15.380 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:15.380 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:23:20.382 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:20.382 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:20.383 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:20.562 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:20.562 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:23:25.563 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:25.563 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:25.564 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:25.744 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:25.745 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:23:30.746 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:30.746 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:30.747 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:30.928 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:30.928 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:23:35.930 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:35.930 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:35.930 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:36.120 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:36.120 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:23:41.121 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:41.122 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:41.122 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:41.307 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:41.307 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:23:46.308 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:46.309 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:46.309 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:46.488 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:46.488 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:23:51.490 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:51.490 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:51.490 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:51.671 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:51.671 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:23:56.672 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:56.673 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:56.673 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:56.862 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:56.863 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:24:01.863 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:01.864 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:01.864 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:02.045 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:02.046 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:24:07.046 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:07.047 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:07.047 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:07.236 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:07.237 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:24:12.238 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:12.238 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:12.238 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:12.426 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:12.427 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:24:17.428 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:17.428 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:17.428 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:17.607 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:17.607 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:24:22.609 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:22.609 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:22.609 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:22.793 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:22.794 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:24:27.794 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:27.794 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:27.795 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:27.976 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:27.976 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:24:32.978 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:32.978 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:32.978 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:33.157 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:33.157 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:24:38.157 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:38.158 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:38.158 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:38.335 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:38.336 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:24:43.336 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:43.336 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:43.337 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:43.523 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:43.523 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:24:48.525 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:48.525 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:48.525 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:48.707 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:48.707 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:24:53.708 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:53.709 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:53.709 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:53.892 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:53.892 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:24:58.893 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:58.893 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:58.893 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:59.080 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:59.081 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:25:04.083 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:04.083 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:04.084 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:04.268 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:04.268 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:25:09.269 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:09.270 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:09.270 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:09.457 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:09.458 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:25:14.459 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:14.459 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:14.460 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:14.647 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:14.647 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:25:19.648 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:19.649 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:19.649 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:19.827 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:19.828 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:25:24.829 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:24.829 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:24.830 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:25.057 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:25.057 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:25:30.057 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:30.058 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:30.058 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:30.239 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:30.239 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:25:35.240 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:35.240 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:35.240 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:35.427 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:35.427 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:25:40.429 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:40.429 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:40.429 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:40.619 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:40.619 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:25:45.620 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:45.620 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:45.620 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:45.799 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:45.799 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:25:50.800 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:50.800 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:50.800 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:50.982 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:50.982 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:25:55.984 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:55.984 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:55.984 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:56.167 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:56.167 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:26:01.168 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:01.169 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:01.169 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:01.356 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:01.357 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:26:06.358 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:06.358 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:06.358 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:06.539 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:06.539 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:26:11.540 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:11.540 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:11.541 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:11.723 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:11.723 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:26:16.725 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:16.725 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:16.725 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:16.914 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:16.915 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:26:21.915 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:21.916 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:21.916 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:22.096 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:22.097 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:26:27.097 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:27.098 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:27.098 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:27.282 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:27.283 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:26:32.283 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:32.284 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:32.284 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:32.463 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:32.464 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:26:37.465 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:37.465 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:37.466 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:37.645 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:37.645 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:26:42.647 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:42.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:42.647 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:42.835 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:42.836 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:26:47.836 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:47.837 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:47.837 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:48.014 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:48.014 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:26:53.015 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:53.015 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:53.015 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:53.199 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:53.199 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:26:58.201 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:58.201 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:58.202 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:58.388 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:58.388 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:27:03.389 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:03.390 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:03.390 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:03.579 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:03.579 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:27:08.581 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:08.581 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:08.581 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:08.764 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:08.764 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:27:13.765 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:13.766 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:13.766 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:13.948 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:13.949 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:27:18.949 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:18.950 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:18.950 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:19.138 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:19.139 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:27:24.140 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:24.140 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:24.140 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:24.326 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:24.327 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:27:29.328 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:29.328 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:29.328 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:29.515 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:29.516 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:27:34.517 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:34.518 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:34.518 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:34.703 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:34.703 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:27:39.704 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:39.704 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:39.704 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:39.886 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:39.886 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:27:44.887 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:44.887 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:44.888 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:45.076 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:45.076 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:27:50.077 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:50.078 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:50.078 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:50.261 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:50.262 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:27:55.263 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:55.263 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:55.263 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:55.485 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:55.486 WARNING:rgw_multi.tests:bucket fggivf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.19.5 target= 2021-02-13T18:28:00.488 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_index_log_trim ... FAIL 2021-02-13T18:28:00.522 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_creation_time ... ok 2021-02-13T18:28:00.522 INFO:tasks.rgw_multisite_tests: 2021-02-13T18:28:00.523 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T18:28:00.523 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_object_sync 2021-02-13T18:28:00.523 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T18:28:00.523 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T18:28:00.523 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T18:28:00.524 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T18:28:00.524 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 618, in test_object_sync 2021-02-13T18:28:00.524 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket.name) 2021-02-13T18:28:00.524 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T18:28:00.524 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T18:28:00.525 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-11 2021-02-13T18:28:00.525 INFO:tasks.rgw_multisite_tests: 2021-02-13T18:28:00.525 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T18:28:00.525 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_object_delete 2021-02-13T18:28:00.525 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T18:28:00.526 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T18:28:00.526 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T18:28:00.526 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T18:28:00.526 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 642, in test_object_delete 2021-02-13T18:28:00.526 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket.name) 2021-02-13T18:28:00.527 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T18:28:00.527 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T18:28:00.527 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-14 2021-02-13T18:28:00.528 INFO:tasks.rgw_multisite_tests: 2021-02-13T18:28:00.528 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T18:28:00.528 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_versioned_object_incremental_sync 2021-02-13T18:28:00.529 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T18:28:00.529 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T18:28:00.529 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T18:28:00.529 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T18:28:00.529 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 680, in test_versioned_object_incremental_sync 2021-02-13T18:28:00.529 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket.name) 2021-02-13T18:28:00.530 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T18:28:00.530 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T18:28:00.530 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-17 2021-02-13T18:28:00.530 INFO:tasks.rgw_multisite_tests: 2021-02-13T18:28:00.530 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T18:28:00.530 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_concurrent_versioned_object_incremental_sync 2021-02-13T18:28:00.531 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T18:28:00.531 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T18:28:00.531 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T18:28:00.531 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T18:28:00.531 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 732, in test_concurrent_versioned_object_incremental_sync 2021-02-13T18:28:00.532 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, bucket.name) 2021-02-13T18:28:00.532 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 409, in zonegroup_bucket_checkpoint 2021-02-13T18:28:00.532 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2021-02-13T18:28:00.532 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T18:28:00.532 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T18:28:00.532 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-19 2021-02-13T18:28:00.532 INFO:tasks.rgw_multisite_tests: 2021-02-13T18:28:00.533 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T18:28:00.533 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_version_suspended_incremental_sync 2021-02-13T18:28:00.533 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T18:28:00.533 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T18:28:00.533 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T18:28:00.534 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T18:28:00.534 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 760, in test_version_suspended_incremental_sync 2021-02-13T18:28:00.534 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, bucket.name) 2021-02-13T18:28:00.534 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 409, in zonegroup_bucket_checkpoint 2021-02-13T18:28:00.534 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2021-02-13T18:28:00.534 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T18:28:00.534 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T18:28:00.535 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-20 2021-02-13T18:28:00.535 INFO:tasks.rgw_multisite_tests: 2021-02-13T18:28:00.535 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T18:28:00.535 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_delete_marker_full_sync 2021-02-13T18:28:00.535 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T18:28:00.536 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T18:28:00.536 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T18:28:00.536 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T18:28:00.536 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 803, in test_delete_marker_full_sync 2021-02-13T18:28:00.536 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, bucket.name) 2021-02-13T18:28:00.537 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 409, in zonegroup_bucket_checkpoint 2021-02-13T18:28:00.537 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2021-02-13T18:28:00.537 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T18:28:00.537 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T18:28:00.537 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-21 2021-02-13T18:28:00.538 INFO:tasks.rgw_multisite_tests: 2021-02-13T18:28:00.538 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T18:28:00.539 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_suspended_delete_marker_full_sync 2021-02-13T18:28:00.539 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T18:28:00.539 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T18:28:00.539 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T18:28:00.539 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T18:28:00.539 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 827, in test_suspended_delete_marker_full_sync 2021-02-13T18:28:00.540 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, bucket.name) 2021-02-13T18:28:00.540 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 409, in zonegroup_bucket_checkpoint 2021-02-13T18:28:00.540 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2021-02-13T18:28:00.540 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T18:28:00.541 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T18:28:00.541 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-24 2021-02-13T18:28:00.541 INFO:tasks.rgw_multisite_tests: 2021-02-13T18:28:00.541 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T18:28:00.541 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_datalog_autotrim 2021-02-13T18:28:00.542 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T18:28:00.542 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T18:28:00.542 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T18:28:00.542 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T18:28:00.542 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 974, in test_datalog_autotrim 2021-02-13T18:28:00.542 INFO:tasks.rgw_multisite_tests: zonegroup_data_checkpoint(zonegroup_conns) 2021-02-13T18:28:00.543 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 379, in zonegroup_data_checkpoint 2021-02-13T18:28:00.543 INFO:tasks.rgw_multisite_tests: zone_data_checkpoint(target_conn.zone, source_conn.zone) 2021-02-13T18:28:00.543 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 371, in zone_data_checkpoint 2021-02-13T18:28:00.543 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name) 2021-02-13T18:28:00.543 INFO:tasks.rgw_multisite_tests:AssertionError: failed data checkpoint for target_zone=test-zone4 source_zone=test-zone2 2021-02-13T18:28:00.543 INFO:tasks.rgw_multisite_tests: 2021-02-13T18:28:00.543 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T18:28:00.544 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_bucket_sync_disable 2021-02-13T18:28:00.544 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T18:28:00.544 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T18:28:00.544 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T18:28:00.544 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T18:28:00.545 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 1122, in test_bucket_sync_disable 2021-02-13T18:28:00.545 INFO:tasks.rgw_multisite_tests: zonegroup_data_checkpoint(zonegroup_conns) 2021-02-13T18:28:00.545 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 379, in zonegroup_data_checkpoint 2021-02-13T18:28:00.545 INFO:tasks.rgw_multisite_tests: zone_data_checkpoint(target_conn.zone, source_conn.zone) 2021-02-13T18:28:00.545 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 371, in zone_data_checkpoint 2021-02-13T18:28:00.545 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name) 2021-02-13T18:28:00.546 INFO:tasks.rgw_multisite_tests:AssertionError: failed data checkpoint for target_zone=test-zone4 source_zone=test-zone2 2021-02-13T18:28:00.546 INFO:tasks.rgw_multisite_tests: 2021-02-13T18:28:00.546 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T18:28:00.546 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_bucket_sync_enable_right_after_disable 2021-02-13T18:28:00.546 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T18:28:00.546 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T18:28:00.547 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T18:28:00.547 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T18:28:00.547 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 1138, in test_bucket_sync_enable_right_after_disable 2021-02-13T18:28:00.547 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, bucket_name) 2021-02-13T18:28:00.547 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 409, in zonegroup_bucket_checkpoint 2021-02-13T18:28:00.547 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2021-02-13T18:28:00.547 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T18:28:00.548 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T18:28:00.548 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-59 2021-02-13T18:28:00.548 INFO:tasks.rgw_multisite_tests: 2021-02-13T18:28:00.548 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T18:28:00.549 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_bucket_sync_disable_enable 2021-02-13T18:28:00.549 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T18:28:00.549 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T18:28:00.549 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T18:28:00.549 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T18:28:00.549 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 1172, in test_bucket_sync_disable_enable 2021-02-13T18:28:00.549 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, bucket_name) 2021-02-13T18:28:00.550 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 409, in zonegroup_bucket_checkpoint 2021-02-13T18:28:00.550 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2021-02-13T18:28:00.550 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T18:28:00.550 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T18:28:00.550 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-62 2021-02-13T18:28:00.550 INFO:tasks.rgw_multisite_tests: 2021-02-13T18:28:00.551 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T18:28:00.551 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_multipart_object_sync 2021-02-13T18:28:00.551 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T18:28:00.552 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T18:28:00.552 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T18:28:00.552 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T18:28:00.552 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 1213, in test_multipart_object_sync 2021-02-13T18:28:00.552 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, bucket.name) 2021-02-13T18:28:00.552 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 409, in zonegroup_bucket_checkpoint 2021-02-13T18:28:00.552 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2021-02-13T18:28:00.553 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T18:28:00.553 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T18:28:00.553 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-65 2021-02-13T18:28:00.554 INFO:tasks.rgw_multisite_tests: 2021-02-13T18:28:00.554 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T18:28:00.554 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_bucket_index_log_trim 2021-02-13T18:28:00.554 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T18:28:00.554 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T18:28:00.554 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T18:28:00.555 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T18:28:00.555 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 1279, in test_bucket_index_log_trim 2021-02-13T18:28:00.555 INFO:tasks.rgw_multisite_tests: cold_bucket = make_test_bucket() 2021-02-13T18:28:00.555 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 1275, in make_test_bucket 2021-02-13T18:28:00.555 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, name) 2021-02-13T18:28:00.555 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 409, in zonegroup_bucket_checkpoint 2021-02-13T18:28:00.555 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2021-02-13T18:28:00.555 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T18:28:00.555 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T18:28:00.555 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-69 2021-02-13T18:28:00.555 INFO:tasks.rgw_multisite_tests: 2021-02-13T18:28:00.555 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T18:28:00.555 INFO:tasks.rgw_multisite_tests:Ran 28 tests in 4748.419s 2021-02-13T18:28:00.556 INFO:tasks.rgw_multisite_tests: 2021-02-13T18:28:00.556 INFO:tasks.rgw_multisite_tests:FAILED (failures=13) 2021-02-13T18:28:00.561 INFO:tasks.rgw_multisite_tests:log information for manual testing ... ok 2021-02-13T18:28:00.562 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:00.562 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:00.562 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:00.632 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:00.648 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240562.240360_224.1","last_update":"2021-02-13 18:22:42.240360Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:00.648 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:28:00.649 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:00.649 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:00.649 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:00.734 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240562.240360_224.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:22:42.240360Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:00.735 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:28:00.735 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:28:00.735 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:00.735 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:00.735 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:00.820 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240562.240360_224.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:22:42.240360Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:00.821 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:28:00.821 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:00.821 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:00.821 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:00.821 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:01.005 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240562.240360_224.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:22:42.240360Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:01.005 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:01.005 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:01.006 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:01.006 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:01.076 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:01.090 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240562.240360_224.1","last_update":"2021-02-13 18:22:42.240360Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:01.091 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:01.091 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:01.091 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:01.091 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:01.282 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240562.240360_224.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:22:42.240360Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:01.282 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:01.344 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:01.344 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:01.344 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:01.437 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:01.452 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240881.332181_232.1","last_update":"2021-02-13 18:28:01.332181Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:01.453 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:01.453 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:01.453 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:01.453 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:01.633 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240881.295262_229.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:01.295262Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:01.633 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=2 master=1_1613240881.332181_232.1 target=1_1613240881.295262_229.1 2021-02-13T18:28:06.634 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:06.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:06.635 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:06.820 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240881.332181_232.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:01.332181Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:06.821 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:07.037 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:07.037 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:07.038 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:07.109 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:07.123 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240881.332181_232.1","last_update":"2021-02-13 18:28:01.332181Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:07.124 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:07.124 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:07.124 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:07.124 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:07.303 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240881.332181_232.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:01.332181Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:07.303 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:07.430 INFO:tasks.rgw_multisite_tests:test low level implementation of s3 notifications ... ok 2021-02-13T18:28:07.430 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:07.430 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:07.431 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:07.534 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:07.548 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240887.418362_234.1","last_update":"2021-02-13 18:28:07.418362Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:07.548 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:28:07.548 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:07.549 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:07.549 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:07.672 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240881.332181_232.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:01.332181Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:07.673 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613240887.418362_234.1 target=1_1613240881.332181_232.1 2021-02-13T18:28:12.674 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:12.674 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:12.675 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:12.756 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240887.418362_234.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:07.418362Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:12.756 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:28:12.756 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:28:12.757 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:12.757 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:12.757 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:12.843 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240887.418362_234.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:07.418362Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:12.843 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:28:12.843 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:12.843 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:12.843 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:12.843 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:13.026 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240887.418362_234.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:07.418362Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:13.027 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:13.027 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:13.027 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:13.027 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:13.088 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:13.103 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240887.418362_234.1","last_update":"2021-02-13 18:28:07.418362Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:13.104 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:13.104 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:13.104 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:13.104 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:13.288 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240887.418362_234.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:07.418362Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:13.289 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:13.353 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:13.353 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:13.353 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:13.456 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:13.472 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240893.340320_238.1","last_update":"2021-02-13 18:28:13.340320Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:13.472 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:13.472 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:13.472 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:13.473 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:13.689 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240893.302843_235.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:13.302843Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:13.690 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=2 master=1_1613240893.340320_238.1 target=1_1613240893.302843_235.1 2021-02-13T18:28:18.690 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:18.690 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:18.691 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:18.878 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240893.340320_238.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:13.340320Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:18.878 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:18.903 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:18.904 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:18.904 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:18.974 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:18.992 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240893.340320_238.1","last_update":"2021-02-13 18:28:13.340320Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:18.993 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:18.993 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:18.993 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:18.993 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:19.214 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240893.340320_238.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:13.340320Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:19.215 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:19.655 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-71', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:19.655 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-71', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:19.656 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-71 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:19.777 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000020.34.5"}]} 2021-02-13T18:28:19.777 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-71 2021-02-13T18:28:19.778 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-71', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:19.778 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-71', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:19.778 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-71 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:19.964 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:28:19.964 WARNING:rgw_multi.tests:bucket fggivf-71 zone test-zone4 behind zone test-zone1: shard=0 master=00000000020.34.5 target= 2021-02-13T18:28:24.965 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-71', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:24.965 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-71', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:24.966 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-71 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:25.156 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"9","instance":"","ns":""},"count":10},"inc_marker":{"position":"0#00000000020.34.5"}}}] 2021-02-13T18:28:25.156 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-71 2021-02-13T18:28:25.161 DEBUG:tasks.rgw_multi.tests_ps:{'eventVersion': '2.2', 'eventSource': 'ceph:s3', 'awsRegion': '', 'eventTime': '2021-02-13 18:28:19.244226Z', 'eventName': 's3:ObjectCreated:*', 'userIdentity': {'principalId': ''}, 'requestParameters': {'sourceIPAddress': ''}, 'responseElements': {'x-amz-request-id': '', 'x-amz-id-2': ''}, 's3': {'s3SchemaVersion': '1.0', 'configurationId': 'fggivf-71_notif', 'bucket': {'name': 'fggivf-71', 'ownerIdentity': {'principalId': 'rgw-multisite-test-user'}, 'arn': 'arn:aws:s3:::fggivf-71', 'id': '828f8250-b337-4094-a551-9a6ba396e2f7.5104.22'}, 'object': {'key': '1', 'size': 0, 'etag': 'dd140c1a', 'versionId': '', 'sequencer': '441A2860BC10561E', 'metadata': [], 'tags': []}}, 'eventId': '1613240900.508956.dd140c1a', 'opaqueData': ''} 2021-02-13T18:28:25.161 DEBUG:tasks.rgw_multi.tests_ps:{'eventVersion': '2.2', 'eventSource': 'ceph:s3', 'awsRegion': '', 'eventTime': '2021-02-13 18:28:19.221370Z', 'eventName': 's3:ObjectCreated:*', 'userIdentity': {'principalId': ''}, 'requestParameters': {'sourceIPAddress': ''}, 'responseElements': {'x-amz-request-id': '', 'x-amz-id-2': ''}, 's3': {'s3SchemaVersion': '1.0', 'configurationId': 'fggivf-71_notif', 'bucket': {'name': 'fggivf-71', 'ownerIdentity': {'principalId': 'rgw-multisite-test-user'}, 'arn': 'arn:aws:s3:::fggivf-71', 'id': '828f8250-b337-4094-a551-9a6ba396e2f7.5104.22'}, 'object': {'key': '0', 'size': 0, 'etag': 'b440c0ce', 'versionId': '', 'sequencer': '441A2860967A581E', 'metadata': [], 'tags': []}}, 'eventId': '1613240900.509115.b440c0ce', 'opaqueData': ''} 2021-02-13T18:28:25.161 DEBUG:tasks.rgw_multi.tests_ps:{'eventVersion': '2.2', 'eventSource': 'ceph:s3', 'awsRegion': '', 'eventTime': '2021-02-13 18:28:19.516842Z', 'eventName': 's3:ObjectCreated:*', 'userIdentity': {'principalId': ''}, 'requestParameters': {'sourceIPAddress': ''}, 'responseElements': {'x-amz-request-id': '', 'x-amz-id-2': ''}, 's3': {'s3SchemaVersion': '1.0', 'configurationId': 'fggivf-71_notif', 'bucket': {'name': 'fggivf-71', 'ownerIdentity': {'principalId': 'rgw-multisite-test-user'}, 'arn': 'arn:aws:s3:::fggivf-71', 'id': '828f8250-b337-4094-a551-9a6ba396e2f7.5104.22'}, 'object': {'key': '7', 'size': 0, 'etag': 'e6472ab1', 'versionId': '', 'sequencer': '441A28606CCB591E', 'metadata': [], 'tags': []}}, 'eventId': '1613240900.509201.e6472ab1', 'opaqueData': ''} 2021-02-13T18:28:25.161 DEBUG:tasks.rgw_multi.tests_ps:{'eventVersion': '2.2', 'eventSource': 'ceph:s3', 'awsRegion': '', 'eventTime': '2021-02-13 18:28:19.332434Z', 'eventName': 's3:ObjectCreated:*', 'userIdentity': {'principalId': ''}, 'requestParameters': {'sourceIPAddress': ''}, 'responseElements': {'x-amz-request-id': '', 'x-amz-id-2': ''}, 's3': {'s3SchemaVersion': '1.0', 'configurationId': 'fggivf-71_notif', 'bucket': {'name': 'fggivf-71', 'ownerIdentity': {'principalId': 'rgw-multisite-test-user'}, 'arn': 'arn:aws:s3:::fggivf-71', 'id': '828f8250-b337-4094-a551-9a6ba396e2f7.5104.22'}, 'object': {'key': '3', 'size': 0, 'etag': 'c67a78f8', 'versionId': '', 'sequencer': '441A28605B6E5A1E', 'metadata': [], 'tags': []}}, 'eventId': '1613240900.509242.c67a78f8', 'opaqueData': ''} 2021-02-13T18:28:25.161 DEBUG:tasks.rgw_multi.tests_ps:{'eventVersion': '2.2', 'eventSource': 'ceph:s3', 'awsRegion': '', 'eventTime': '2021-02-13 18:28:19.560867Z', 'eventName': 's3:ObjectCreated:*', 'userIdentity': {'principalId': ''}, 'requestParameters': {'sourceIPAddress': ''}, 'responseElements': {'x-amz-request-id': '', 'x-amz-id-2': ''}, 's3': {'s3SchemaVersion': '1.0', 'configurationId': 'fggivf-71_notif', 'bucket': {'name': 'fggivf-71', 'ownerIdentity': {'principalId': 'rgw-multisite-test-user'}, 'arn': 'arn:aws:s3:::fggivf-71', 'id': '828f8250-b337-4094-a551-9a6ba396e2f7.5104.22'}, 'object': {'key': '8', 'size': 0, 'etag': '9dfa3ce2', 'versionId': '', 'sequencer': '441A2860FED55C1E', 'metadata': [], 'tags': []}}, 'eventId': '1613240900.509400.9dfa3ce2', 'opaqueData': ''} 2021-02-13T18:28:25.162 DEBUG:tasks.rgw_multi.tests_ps:{'eventVersion': '2.2', 'eventSource': 'ceph:s3', 'awsRegion': '', 'eventTime': '2021-02-13 18:28:19.288466Z', 'eventName': 's3:ObjectCreated:*', 'userIdentity': {'principalId': ''}, 'requestParameters': {'sourceIPAddress': ''}, 'responseElements': {'x-amz-request-id': '', 'x-amz-id-2': ''}, 's3': {'s3SchemaVersion': '1.0', 'configurationId': 'fggivf-71_notif', 'bucket': {'name': 'fggivf-71', 'ownerIdentity': {'principalId': 'rgw-multisite-test-user'}, 'arn': 'arn:aws:s3:::fggivf-71', 'id': '828f8250-b337-4094-a551-9a6ba396e2f7.5104.22'}, 'object': {'key': '2', 'size': 0, 'etag': '0644e9c5', 'versionId': '', 'sequencer': '441A28601755611E', 'metadata': [], 'tags': []}}, 'eventId': '1613240900.509695.0644e9c5', 'opaqueData': ''} 2021-02-13T18:28:25.162 DEBUG:tasks.rgw_multi.tests_ps:{'eventVersion': '2.2', 'eventSource': 'ceph:s3', 'awsRegion': '', 'eventTime': '2021-02-13 18:28:19.377143Z', 'eventName': 's3:ObjectCreated:*', 'userIdentity': {'principalId': ''}, 'requestParameters': {'sourceIPAddress': ''}, 'responseElements': {'x-amz-request-id': '', 'x-amz-id-2': ''}, 's3': {'s3SchemaVersion': '1.0', 'configurationId': 'fggivf-71_notif', 'bucket': {'name': 'fggivf-71', 'ownerIdentity': {'principalId': 'rgw-multisite-test-user'}, 'arn': 'arn:aws:s3:::fggivf-71', 'id': '828f8250-b337-4094-a551-9a6ba396e2f7.5104.22'}, 'object': {'key': '4', 'size': 0, 'etag': '698b43f9', 'versionId': '', 'sequencer': '441A2860E6A2621E', 'metadata': [], 'tags': []}}, 'eventId': '1613240900.509780.698b43f9', 'opaqueData': ''} 2021-02-13T18:28:25.162 DEBUG:tasks.rgw_multi.tests_ps:{'eventVersion': '2.2', 'eventSource': 'ceph:s3', 'awsRegion': '', 'eventTime': '2021-02-13 18:28:19.468542Z', 'eventName': 's3:ObjectCreated:*', 'userIdentity': {'principalId': ''}, 'requestParameters': {'sourceIPAddress': ''}, 'responseElements': {'x-amz-request-id': '', 'x-amz-id-2': ''}, 's3': {'s3SchemaVersion': '1.0', 'configurationId': 'fggivf-71_notif', 'bucket': {'name': 'fggivf-71', 'ownerIdentity': {'principalId': 'rgw-multisite-test-user'}, 'arn': 'arn:aws:s3:::fggivf-71', 'id': '828f8250-b337-4094-a551-9a6ba396e2f7.5104.22'}, 'object': {'key': '6', 'size': 0, 'etag': '1edaf961', 'versionId': '', 'sequencer': '441A28603B6E631E', 'metadata': [], 'tags': []}}, 'eventId': '1613240900.509832.1edaf961', 'opaqueData': ''} 2021-02-13T18:28:25.162 DEBUG:tasks.rgw_multi.tests_ps:{'eventVersion': '2.2', 'eventSource': 'ceph:s3', 'awsRegion': '', 'eventTime': '2021-02-13 18:28:19.608957Z', 'eventName': 's3:ObjectCreated:*', 'userIdentity': {'principalId': ''}, 'requestParameters': {'sourceIPAddress': ''}, 'responseElements': {'x-amz-request-id': '', 'x-amz-id-2': ''}, 's3': {'s3SchemaVersion': '1.0', 'configurationId': 'fggivf-71_notif', 'bucket': {'name': 'fggivf-71', 'ownerIdentity': {'principalId': 'rgw-multisite-test-user'}, 'arn': 'arn:aws:s3:::fggivf-71', 'id': '828f8250-b337-4094-a551-9a6ba396e2f7.5104.22'}, 'object': {'key': '9', 'size': 0, 'etag': '27c46b76', 'versionId': '', 'sequencer': '441A28607CD7641E', 'metadata': [], 'tags': []}}, 'eventId': '1613240900.509925.27c46b76', 'opaqueData': ''} 2021-02-13T18:28:25.162 DEBUG:tasks.rgw_multi.tests_ps:{'eventVersion': '2.2', 'eventSource': 'ceph:s3', 'awsRegion': '', 'eventTime': '2021-02-13 18:28:19.424407Z', 'eventName': 's3:ObjectCreated:*', 'userIdentity': {'principalId': ''}, 'requestParameters': {'sourceIPAddress': ''}, 'responseElements': {'x-amz-request-id': '', 'x-amz-id-2': ''}, 's3': {'s3SchemaVersion': '1.0', 'configurationId': 'fggivf-71_notif', 'bucket': {'name': 'fggivf-71', 'ownerIdentity': {'principalId': 'rgw-multisite-test-user'}, 'arn': 'arn:aws:s3:::fggivf-71', 'id': '828f8250-b337-4094-a551-9a6ba396e2f7.5104.22'}, 'object': {'key': '5', 'size': 0, 'etag': '3a50d6a6', 'versionId': '', 'sequencer': '441A2860A57B711E', 'metadata': [], 'tags': []}}, 'eventId': '1613240900.510753.3a50d6a6', 'opaqueData': ''} 2021-02-13T18:28:25.168 WARNING:tasks.rgw_multi.tests_ps:superfluous records are found 2021-02-13T18:28:25.409 INFO:tasks.rgw_multisite_tests:test s3 records fetching ... ok 2021-02-13T18:28:25.409 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:25.409 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:25.410 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:25.507 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:25.523 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240905.396653_240.1","last_update":"2021-02-13 18:28:25.396653Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:25.523 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:28:25.523 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:25.523 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:25.524 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:25.602 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240893.340320_238.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:13.340320Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:25.603 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613240905.396653_240.1 target=1_1613240893.340320_238.1 2021-02-13T18:28:30.603 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:30.604 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:30.604 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:30.697 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240905.396653_240.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:25.396653Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:30.697 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:28:30.697 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:28:30.697 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:30.697 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:30.698 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:30.786 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240905.396653_240.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:25.396653Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:30.786 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:28:30.786 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:30.787 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:30.787 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:30.787 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:31.007 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240905.396653_240.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:25.396653Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:31.008 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:31.008 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:31.008 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:31.008 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:31.115 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:31.132 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240905.396653_240.1","last_update":"2021-02-13 18:28:25.396653Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:31.133 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:31.133 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:31.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:31.133 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:31.685 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240905.396653_240.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:25.396653Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:31.686 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:31.750 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:31.751 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:31.751 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:31.853 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:31.869 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240911.737900_244.1","last_update":"2021-02-13 18:28:31.737900Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:31.869 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:31.869 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:31.870 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:31.870 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:32.092 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240905.396653_240.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:25.396653Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:32.093 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=2 master=1_1613240911.737900_244.1 target=1_1613240905.396653_240.1 2021-02-13T18:28:37.094 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:37.094 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:37.094 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:37.275 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240911.737900_244.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:31.737900Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:37.276 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:37.326 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:37.326 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:37.326 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:37.433 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:37.449 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240911.737900_244.1","last_update":"2021-02-13 18:28:31.737900Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:37.449 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:37.450 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:37.450 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:37.450 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:37.672 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240911.737900_244.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:31.737900Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:37.673 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:37.821 INFO:tasks.rgw_multisite_tests:test s3 notification set/get/delete ... ok 2021-02-13T18:28:37.821 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:37.821 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:37.821 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:37.925 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:37.942 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240917.807530_246.1","last_update":"2021-02-13 18:28:37.807530Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:37.942 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:28:37.942 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:37.942 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:37.943 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:38.068 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240911.737900_244.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:31.737900Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:38.068 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613240917.807530_246.1 target=1_1613240911.737900_244.1 2021-02-13T18:28:43.069 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:43.069 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:43.070 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:43.151 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240917.807530_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:37.807530Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:43.151 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:28:43.151 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:28:43.151 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:43.151 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:43.152 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:43.238 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240917.807530_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:37.807530Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:43.239 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:28:43.239 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:43.239 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:43.239 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:43.239 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:43.427 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240917.807530_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:37.807530Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:43.428 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:43.428 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:43.428 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:43.428 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:43.500 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:43.516 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240917.807530_246.1","last_update":"2021-02-13 18:28:37.807530Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:43.516 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:43.516 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:43.516 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:43.517 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:43.736 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240917.807530_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:37.807530Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:43.737 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:43.876 INFO:tasks.rgw_multisite_tests:test s3 topics set/get/delete on master ... ok 2021-02-13T18:28:43.877 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:43.877 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:43.877 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:43.984 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:44.001 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240917.807530_246.1","last_update":"2021-02-13 18:28:37.807530Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:44.001 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:28:44.001 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:44.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:44.001 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:44.095 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240917.807530_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:37.807530Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:44.096 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:28:44.096 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:28:44.096 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:44.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:44.096 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:44.218 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240917.807530_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:37.807530Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:44.218 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:28:44.219 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:44.219 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:44.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:44.219 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:44.406 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240917.807530_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:37.807530Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:44.406 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:44.406 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:44.406 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:44.407 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:44.478 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:44.494 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240917.807530_246.1","last_update":"2021-02-13 18:28:37.807530Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:44.494 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:44.494 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:44.494 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:44.495 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:44.717 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240917.807530_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:37.807530Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:44.717 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:44.717 INFO:tasks.rgw_multisite_tests:test s3 topics with secret set/get/delete on master ... ok 2021-02-13T18:28:44.718 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:44.718 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:44.718 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:44.788 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:44.804 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240917.807530_246.1","last_update":"2021-02-13 18:28:37.807530Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:44.804 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:28:44.804 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:44.805 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:44.805 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:44.925 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240917.807530_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:37.807530Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:44.926 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:28:44.926 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:28:44.926 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:44.926 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:44.926 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:45.009 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240917.807530_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:37.807530Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:45.010 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:28:45.010 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:45.010 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:45.010 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:45.011 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:45.228 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240917.807530_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:37.807530Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:45.229 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:45.229 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:45.229 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:45.229 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:45.302 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:45.318 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240917.807530_246.1","last_update":"2021-02-13 18:28:37.807530Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:45.318 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:45.318 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:45.318 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:45.319 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:45.504 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240917.807530_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:37.807530Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:45.504 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:45.822 INFO:tasks.rgw_multisite_tests:test s3 notification set/get/delete on master ... ok 2021-02-13T18:28:45.823 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests_ps.test_ps_s3_notification_filter_on_master ... ok 2021-02-13T18:28:45.823 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests_ps.test_ps_s3_notification_filter ... ok 2021-02-13T18:28:45.823 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:45.823 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:45.823 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:45.921 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:45.936 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240925.808976_252.1","last_update":"2021-02-13 18:28:45.808976Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:45.936 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:28:45.937 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:45.937 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:45.937 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:46.018 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240917.807530_246.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:37.807530Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:46.019 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613240925.808976_252.1 target=1_1613240917.807530_246.1 2021-02-13T18:28:51.020 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:51.020 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:51.020 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:51.102 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240925.808976_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:45.808976Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:51.102 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:28:51.102 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:28:51.103 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:51.103 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:51.103 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:51.183 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240925.808976_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:45.808976Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:51.183 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:28:51.184 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:51.184 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:51.184 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:51.184 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:51.369 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240925.808976_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:45.808976Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:51.369 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:51.370 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:51.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:51.370 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:51.477 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:51.493 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240925.808976_252.1","last_update":"2021-02-13 18:28:45.808976Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:51.494 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:51.494 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:51.494 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:51.494 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:51.672 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240925.808976_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:45.808976Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:51.672 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:51.921 INFO:tasks.rgw_multisite_tests:test s3 notification set/get/delete on master ... ok 2021-02-13T18:28:51.921 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests_ps.test_objcet_timing ... ok 2021-02-13T18:28:51.922 INFO:tasks.rgw_multisite_tests:test pushing amqp s3 notification on master ... ok 2021-02-13T18:28:51.922 INFO:tasks.rgw_multisite_tests:test pushing kafka s3 notification on master ... ok 2021-02-13T18:28:51.922 INFO:tasks.rgw_multisite_tests:test pushing kafka s3 notification on master ... ok 2021-02-13T18:28:51.922 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests_ps.test_ps_s3_notification_push_kafka_security_ssl ... ok 2021-02-13T18:28:51.922 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests_ps.test_ps_s3_notification_push_kafka_security_ssl_sasl ... ok 2021-02-13T18:28:51.923 INFO:tasks.rgw_multisite_tests:test deletion of multiple keys on master ... ok 2021-02-13T18:28:51.923 INFO:tasks.rgw_multisite_tests:test pushing http s3 notification on master ... ok 2021-02-13T18:28:51.923 INFO:tasks.rgw_multisite_tests:test that opaque id set in topic, is sent in notification ... ok 2021-02-13T18:28:51.923 INFO:tasks.rgw_multisite_tests:test that opaque id set in topic, is sent in notification on master ... ok 2021-02-13T18:28:51.923 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:51.924 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:51.924 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:52.028 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:52.044 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240931.909068_263.1","last_update":"2021-02-13 18:28:51.909068Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:52.044 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:28:52.045 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:52.045 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:52.045 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:52.482 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240925.808976_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:45.808976Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:52.483 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613240931.909068_263.1 target=1_1613240925.808976_252.1 2021-02-13T18:28:57.484 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:57.484 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:57.484 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:57.571 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240931.909068_263.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:51.909068Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:57.572 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:28:57.572 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:28:57.572 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:57.572 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:57.572 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:57.657 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240931.909068_263.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:51.909068Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:57.657 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:28:57.657 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:57.658 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:57.658 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:57.658 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:57.840 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240931.909068_263.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:51.909068Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:57.840 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:57.841 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:57.841 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:57.841 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:57.906 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:57.923 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240931.909068_263.1","last_update":"2021-02-13 18:28:51.909068Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:57.924 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:57.924 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:57.924 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:57.925 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:58.104 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240931.909068_263.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:51.909068Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:58.105 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:58.136 INFO:tasks.rgw_multisite_tests:test set/get/delete of topic ... ok 2021-02-13T18:28:58.136 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:58.136 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:58.137 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:58.210 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:58.231 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240931.909068_263.1","last_update":"2021-02-13 18:28:51.909068Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:58.232 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:28:58.232 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:58.232 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:58.232 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:58.354 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240931.909068_263.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:51.909068Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:58.354 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:28:58.354 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:28:58.354 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:58.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:58.355 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:58.480 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240931.909068_263.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:51.909068Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:58.481 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:28:58.481 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:58.481 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:58.481 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:58.482 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:58.662 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240931.909068_263.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:51.909068Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:58.662 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:58.662 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:58.662 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:58.663 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:58.769 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:58.786 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240931.909068_263.1","last_update":"2021-02-13 18:28:51.909068Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:58.786 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:58.787 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:58.787 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:58.787 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:59.004 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240931.909068_263.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:51.909068Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:59.005 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:59.017 INFO:tasks.rgw_multisite_tests:test set topic with endpoint ... ok 2021-02-13T18:28:59.017 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:59.018 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:59.018 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:59.127 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:59.142 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240931.909068_263.1","last_update":"2021-02-13 18:28:51.909068Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:59.143 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:28:59.143 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:59.143 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:59.143 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:59.227 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240931.909068_263.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:51.909068Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:59.228 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:28:59.228 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:28:59.228 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:59.229 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:59.229 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:59.355 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240931.909068_263.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:51.909068Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:59.356 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:28:59.356 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:59.356 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:59.356 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:59.357 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:59.574 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240931.909068_263.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:51.909068Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:59.574 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:59.574 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:59.575 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:59.575 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:59.646 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:28:59.662 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240931.909068_263.1","last_update":"2021-02-13 18:28:51.909068Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:28:59.662 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:28:59.662 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:59.662 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:59.663 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:59.847 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240931.909068_263.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:51.909068Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:28:59.848 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:28:59.925 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:59.926 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:59.926 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:00.027 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:29:00.043 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240939.912936_268.1","last_update":"2021-02-13 18:28:59.912936Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:29:00.043 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:29:00.043 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:00.043 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:00.043 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:00.217 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240931.909068_263.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:51.909068Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:00.218 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=2 master=1_1613240939.912936_268.1 target=1_1613240931.909068_263.1 2021-02-13T18:29:05.219 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:05.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:05.220 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:05.406 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240939.912936_268.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:59.912936Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:05.406 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:29:05.498 INFO:tasks.rgw_multisite_tests:test set/get/delete of notification ... ok 2021-02-13T18:29:05.498 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:05.499 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:05.499 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:05.570 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:29:05.586 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240945.485539_270.1","last_update":"2021-02-13 18:29:05.485539Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:29:05.586 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:29:05.587 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:05.587 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:05.587 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:05.712 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240939.912936_268.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:28:59.912936Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:05.712 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613240945.485539_270.1 target=1_1613240939.912936_268.1 2021-02-13T18:29:10.713 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:10.713 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:10.714 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:10.803 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240945.485539_270.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:05.485539Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:10.804 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:29:10.804 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:29:10.804 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:10.804 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:10.805 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:10.894 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240945.485539_270.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:05.485539Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:10.895 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:29:10.895 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:29:10.895 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:10.895 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:10.896 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:11.097 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240945.485539_270.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:05.485539Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:11.097 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:29:11.097 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:11.097 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:11.097 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:11.204 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:29:11.220 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240945.485539_270.1","last_update":"2021-02-13 18:29:05.485539Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:29:11.221 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:29:11.221 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:11.221 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:11.222 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:11.442 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240945.485539_270.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:05.485539Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:11.443 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:29:11.510 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:11.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:11.511 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:11.611 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:29:11.627 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240951.497692_274.1","last_update":"2021-02-13 18:29:11.497692Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:29:11.627 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:29:11.628 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:11.628 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:11.628 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:11.847 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240945.485539_270.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:05.485539Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:11.847 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=2 master=1_1613240951.497692_274.1 target=1_1613240945.485539_270.1 2021-02-13T18:29:16.849 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:16.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:16.849 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:17.037 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240951.497692_274.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:11.497692Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:17.038 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:29:17.126 INFO:tasks.rgw_multisite_tests:test set/get/delete of notification on specific events ... ok 2021-02-13T18:29:17.127 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:17.127 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:17.127 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:17.230 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:29:17.246 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240957.113420_276.1","last_update":"2021-02-13 18:29:17.113420Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:29:17.246 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:29:17.246 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:17.247 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:17.247 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:17.328 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240951.497692_274.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:11.497692Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:17.328 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613240957.113420_276.1 target=1_1613240951.497692_274.1 2021-02-13T18:29:22.329 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:22.329 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:22.330 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:22.404 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240957.113420_276.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:17.113420Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:22.404 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:29:22.404 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:29:22.405 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:22.405 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:22.405 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:22.488 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240957.113420_276.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:17.113420Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:22.488 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:29:22.488 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:29:22.488 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:22.488 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:22.489 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:22.669 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240957.113420_276.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:17.113420Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:22.669 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:29:22.669 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:22.670 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:22.670 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:22.732 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:29:22.750 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240957.113420_276.1","last_update":"2021-02-13 18:29:17.113420Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:29:22.750 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:29:22.750 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:22.750 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:22.751 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:22.972 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240957.113420_276.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:17.113420Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:22.972 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:29:23.008 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:23.009 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:23.009 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:23.085 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:29:23.105 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240963.005097_280.1","last_update":"2021-02-13 18:29:23.005097Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:29:23.106 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:29:23.106 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:23.106 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:23.106 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:23.289 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240957.113420_276.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:17.113420Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:23.289 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=2 master=1_1613240963.005097_280.1 target=1_1613240957.113420_276.1 2021-02-13T18:29:28.290 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:28.290 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:28.290 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:28.473 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240963.005097_280.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:23.005097Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:28.474 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:29:28.923 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-80', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:28.923 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-80', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:28.923 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-80 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:29.047 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000020.24.5"}]} 2021-02-13T18:29:29.047 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-80 2021-02-13T18:29:29.048 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-80', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:29.048 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-80', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:29.048 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-80 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:29.234 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:29:29.235 WARNING:rgw_multi.tests:bucket fggivf-80 zone test-zone4 behind zone test-zone1: shard=0 master=00000000020.24.5 target= 2021-02-13T18:29:34.235 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-80', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:34.235 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-80', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:34.236 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-80 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:34.418 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"9","instance":"","ns":""},"count":10},"inc_marker":{"position":"0#00000000020.24.5"}}}] 2021-02-13T18:29:34.418 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-80 2021-02-13T18:29:34.423 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "4" type: "OBJECT_CREATE" 2021-02-13T18:29:34.423 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "0" type: "OBJECT_CREATE" 2021-02-13T18:29:34.423 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "2" type: "OBJECT_CREATE" 2021-02-13T18:29:34.423 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "3" type: "OBJECT_CREATE" 2021-02-13T18:29:34.423 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "9" type: "OBJECT_CREATE" 2021-02-13T18:29:34.423 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "6" type: "OBJECT_CREATE" 2021-02-13T18:29:34.423 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "5" type: "OBJECT_CREATE" 2021-02-13T18:29:34.423 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "1" type: "OBJECT_CREATE" 2021-02-13T18:29:34.423 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "8" type: "OBJECT_CREATE" 2021-02-13T18:29:34.423 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "7" type: "OBJECT_CREATE" 2021-02-13T18:29:34.430 DEBUG:tasks.rgw_multi.tests_ps:superfluous events are found 2021-02-13T18:29:34.602 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:34.602 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:34.603 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:34.701 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:29:34.717 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240963.005097_280.1","last_update":"2021-02-13 18:29:23.005097Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:29:34.718 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:29:34.718 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:34.718 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:34.718 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:34.939 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240963.005097_280.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:23.005097Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:34.940 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:29:34.940 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-80', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:34.940 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-80', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:34.940 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-80 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:35.065 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000040.44.5"}]} 2021-02-13T18:29:35.065 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-80 2021-02-13T18:29:35.065 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-80', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:35.065 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-80', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:35.065 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-80 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:35.280 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"9","instance":"","ns":""},"count":10},"inc_marker":{"position":"0#00000000020.24.5"}}}] 2021-02-13T18:29:35.281 WARNING:rgw_multi.tests:bucket fggivf-80 zone test-zone4 behind zone test-zone1: shard=0 master=00000000040.44.5 target=00000000020.24.5 2021-02-13T18:29:40.282 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-80', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:40.282 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-80', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:40.283 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-80 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:40.472 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"9","instance":"","ns":""},"count":10},"inc_marker":{"position":"00000000040.44.5"}}}] 2021-02-13T18:29:40.472 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-80 2021-02-13T18:29:40.477 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "4" type: "OBJECT_CREATE" 2021-02-13T18:29:40.477 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "0" type: "OBJECT_CREATE" 2021-02-13T18:29:40.477 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "2" type: "OBJECT_CREATE" 2021-02-13T18:29:40.477 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "3" type: "OBJECT_CREATE" 2021-02-13T18:29:40.477 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "9" type: "OBJECT_CREATE" 2021-02-13T18:29:40.477 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "6" type: "OBJECT_CREATE" 2021-02-13T18:29:40.477 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "5" type: "OBJECT_CREATE" 2021-02-13T18:29:40.477 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "1" type: "OBJECT_CREATE" 2021-02-13T18:29:40.478 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "8" type: "OBJECT_CREATE" 2021-02-13T18:29:40.478 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "7" type: "OBJECT_CREATE" 2021-02-13T18:29:40.538 INFO:tasks.rgw_multisite_tests:test set/get/delete of subscription ... ok 2021-02-13T18:29:40.539 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:40.539 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:40.539 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:40.610 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:29:40.628 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240980.526007_282.1","last_update":"2021-02-13 18:29:40.526007Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:29:40.629 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:29:40.629 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:40.629 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:40.629 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:40.757 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240963.005097_280.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:23.005097Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:40.757 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613240980.526007_282.1 target=1_1613240963.005097_280.1 2021-02-13T18:29:45.758 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:45.758 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:45.759 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:45.850 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240980.526007_282.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:40.526007Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:45.850 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:29:45.850 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:29:45.851 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:45.851 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:45.851 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:45.938 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240980.526007_282.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:40.526007Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:45.938 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:29:45.938 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:29:45.938 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:45.939 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:45.939 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:46.124 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240980.526007_282.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:40.526007Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:46.125 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:29:46.125 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:46.125 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:46.125 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:46.233 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:29:46.251 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240980.526007_282.1","last_update":"2021-02-13 18:29:40.526007Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:29:46.251 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:29:46.251 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:46.251 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:46.252 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:46.474 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240980.526007_282.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:40.526007Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:46.474 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:29:46.577 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:46.577 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:46.577 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:46.676 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:29:46.691 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240986.563817_286.1","last_update":"2021-02-13 18:29:46.563817Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:29:46.691 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:29:46.691 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:46.691 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:46.691 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:46.906 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240986.563817_286.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:46.563817Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:46.906 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:29:46.906 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-81', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:46.907 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-81', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:46.907 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-81 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:47.030 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":""}]} 2021-02-13T18:29:47.030 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-81 2021-02-13T18:29:47.031 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-81', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:47.031 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-81', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:47.031 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-81 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:47.211 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:29:47.212 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-81 2021-02-13T18:29:47.751 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-81', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:47.751 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-81', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:47.751 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-81 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:47.871 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000020.22.5"}]} 2021-02-13T18:29:47.872 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-81 2021-02-13T18:29:47.872 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-81', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:47.872 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-81', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:47.872 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-81 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:48.051 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:29:48.051 WARNING:rgw_multi.tests:bucket fggivf-81 zone test-zone4 behind zone test-zone1: shard=0 master=00000000020.22.5 target= 2021-02-13T18:29:53.053 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-81', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:53.053 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-81', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:53.053 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-81 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:53.243 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"9","instance":"","ns":""},"count":10},"inc_marker":{"position":"0#00000000020.22.5"}}}] 2021-02-13T18:29:53.243 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-81 2021-02-13T18:29:53.248 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "1" type: "OBJECT_CREATE" 2021-02-13T18:29:53.248 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "2" type: "OBJECT_CREATE" 2021-02-13T18:29:53.248 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "9" type: "OBJECT_CREATE" 2021-02-13T18:29:53.248 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "8" type: "OBJECT_CREATE" 2021-02-13T18:29:53.249 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "7" type: "OBJECT_CREATE" 2021-02-13T18:29:53.249 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "5" type: "OBJECT_CREATE" 2021-02-13T18:29:53.249 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "6" type: "OBJECT_CREATE" 2021-02-13T18:29:53.249 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "0" type: "OBJECT_CREATE" 2021-02-13T18:29:53.249 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "4" type: "OBJECT_CREATE" 2021-02-13T18:29:53.249 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "3" type: "OBJECT_CREATE" 2021-02-13T18:29:53.256 DEBUG:tasks.rgw_multi.tests_ps:superfluous events are found 2021-02-13T18:29:53.261 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "1" type: "OBJECT_CREATE" 2021-02-13T18:29:53.261 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "2" type: "OBJECT_CREATE" 2021-02-13T18:29:53.261 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "9" type: "OBJECT_CREATE" 2021-02-13T18:29:53.261 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "8" type: "OBJECT_CREATE" 2021-02-13T18:29:53.262 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "7" type: "OBJECT_CREATE" 2021-02-13T18:29:53.262 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "5" type: "OBJECT_CREATE" 2021-02-13T18:29:53.262 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "6" type: "OBJECT_CREATE" 2021-02-13T18:29:53.262 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "0" type: "OBJECT_CREATE" 2021-02-13T18:29:53.262 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "4" type: "OBJECT_CREATE" 2021-02-13T18:29:53.262 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "3" type: "OBJECT_CREATE" 2021-02-13T18:29:53.262 DEBUG:tasks.rgw_multi.tests_ps:superfluous events are found 2021-02-13T18:29:53.387 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-81', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:53.387 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-81', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:53.388 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-81 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:53.470 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000040.42.5"}]} 2021-02-13T18:29:53.470 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-81 2021-02-13T18:29:53.471 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-81', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:53.471 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-81', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:53.471 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-81 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:53.695 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"9","instance":"","ns":""},"count":10},"inc_marker":{"position":"0#00000000020.22.5"}}}] 2021-02-13T18:29:53.695 WARNING:rgw_multi.tests:bucket fggivf-81 zone test-zone4 behind zone test-zone1: shard=0 master=00000000040.42.5 target=00000000020.22.5 2021-02-13T18:29:58.696 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-81', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:58.696 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-81', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:58.697 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-81 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:58.883 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"9","instance":"","ns":""},"count":10},"inc_marker":{"position":"00000000040.42.5"}}}] 2021-02-13T18:29:58.884 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-81 2021-02-13T18:29:58.884 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE) synced 2021-02-13T18:29:58.888 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "1" type: "OBJECT_CREATE" 2021-02-13T18:29:58.888 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "2" type: "OBJECT_CREATE" 2021-02-13T18:29:58.888 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "9" type: "OBJECT_CREATE" 2021-02-13T18:29:58.888 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "8" type: "OBJECT_CREATE" 2021-02-13T18:29:58.888 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "7" type: "OBJECT_CREATE" 2021-02-13T18:29:58.888 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "5" type: "OBJECT_CREATE" 2021-02-13T18:29:58.888 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "6" type: "OBJECT_CREATE" 2021-02-13T18:29:58.888 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "0" type: "OBJECT_CREATE" 2021-02-13T18:29:58.888 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "4" type: "OBJECT_CREATE" 2021-02-13T18:29:58.888 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "3" type: "OBJECT_CREATE" 2021-02-13T18:29:58.888 DEBUG:tasks.rgw_multi.tests_ps:superfluous events are found 2021-02-13T18:29:58.892 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE): objname: "0" type: "OBJECT_DELETE" 2021-02-13T18:29:58.892 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE): objname: "1" type: "OBJECT_DELETE" 2021-02-13T18:29:58.892 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE): objname: "2" type: "OBJECT_DELETE" 2021-02-13T18:29:58.892 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE): objname: "3" type: "OBJECT_DELETE" 2021-02-13T18:29:58.892 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE): objname: "4" type: "OBJECT_DELETE" 2021-02-13T18:29:58.893 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE): objname: "5" type: "OBJECT_DELETE" 2021-02-13T18:29:58.893 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE): objname: "6" type: "OBJECT_DELETE" 2021-02-13T18:29:58.893 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE): objname: "7" type: "OBJECT_DELETE" 2021-02-13T18:29:58.893 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE): objname: "8" type: "OBJECT_DELETE" 2021-02-13T18:29:58.893 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE): objname: "9" type: "OBJECT_DELETE" 2021-02-13T18:29:58.893 DEBUG:tasks.rgw_multi.tests_ps:superfluous events are found 2021-02-13T18:29:58.896 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "1" type: "OBJECT_CREATE" 2021-02-13T18:29:58.896 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "2" type: "OBJECT_CREATE" 2021-02-13T18:29:58.896 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "9" type: "OBJECT_CREATE" 2021-02-13T18:29:58.896 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "8" type: "OBJECT_CREATE" 2021-02-13T18:29:58.896 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "7" type: "OBJECT_CREATE" 2021-02-13T18:29:58.897 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "5" type: "OBJECT_CREATE" 2021-02-13T18:29:58.897 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "6" type: "OBJECT_CREATE" 2021-02-13T18:29:58.897 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "0" type: "OBJECT_CREATE" 2021-02-13T18:29:58.897 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "4" type: "OBJECT_CREATE" 2021-02-13T18:29:58.897 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "3" type: "OBJECT_CREATE" 2021-02-13T18:29:58.897 DEBUG:tasks.rgw_multi.tests_ps:superfluous events are found 2021-02-13T18:29:59.027 INFO:tasks.rgw_multisite_tests:test subscriptions for different events ... ok 2021-02-13T18:29:59.027 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:59.027 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:59.027 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:59.098 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:29:59.113 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240999.014753_288.1","last_update":"2021-02-13 18:29:59.014753Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:29:59.113 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:29:59.114 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:59.114 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:59.114 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:59.239 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240986.563817_286.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:46.563817Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:59.239 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613240999.014753_288.1 target=1_1613240986.563817_286.1 2021-02-13T18:30:04.241 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:04.241 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:04.241 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:04.670 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240999.014753_288.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:59.014753Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:04.670 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:30:04.670 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:30:04.671 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:04.671 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:04.671 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:04.754 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240999.014753_288.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:59.014753Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:04.755 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:30:04.755 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:30:04.755 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:04.755 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:04.755 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:04.976 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240999.014753_288.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:59.014753Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:04.977 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:30:04.977 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:04.977 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:04.977 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:05.041 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:30:05.056 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613240999.014753_288.1","last_update":"2021-02-13 18:29:59.014753Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:30:05.057 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:30:05.057 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:05.057 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:05.057 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:05.278 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240999.014753_288.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:59.014753Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:05.278 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:30:05.353 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:05.353 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:05.354 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:05.456 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:30:05.472 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241005.341593_292.1","last_update":"2021-02-13 18:30:05.341593Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:30:05.473 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:30:05.473 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:05.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:05.474 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:05.659 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613240999.014753_288.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:59.014753Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:05.659 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=2 master=1_1613241005.341593_292.1 target=1_1613240999.014753_288.1 2021-02-13T18:30:10.660 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:10.694 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:10.694 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:10.883 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241005.341593_292.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:05.341593Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:11.183 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:30:15.655 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-82', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:15.655 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-82', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:15.655 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-82 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:15.810 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000200.222.5"}]} 2021-02-13T18:30:15.811 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-82 2021-02-13T18:30:15.811 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-82', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:15.811 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-82', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:15.811 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-82 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:16.034 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"9","instance":"","ns":""},"count":28},"inc_marker":{"position":"00000000200.222.5"}}}] 2021-02-13T18:30:16.035 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-82 2021-02-13T18:30:16.056 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "22" type: "OBJECT_CREATE" 2021-02-13T18:30:16.056 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "13" type: "OBJECT_CREATE" 2021-02-13T18:30:16.056 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "14" type: "OBJECT_CREATE" 2021-02-13T18:30:16.056 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "17" type: "OBJECT_CREATE" 2021-02-13T18:30:16.057 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "21" type: "OBJECT_CREATE" 2021-02-13T18:30:16.057 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "11" type: "OBJECT_CREATE" 2021-02-13T18:30:16.057 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "12" type: "OBJECT_CREATE" 2021-02-13T18:30:16.057 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "26" type: "OBJECT_CREATE" 2021-02-13T18:30:16.057 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "27" type: "OBJECT_CREATE" 2021-02-13T18:30:16.057 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "15" type: "OBJECT_CREATE" 2021-02-13T18:30:16.057 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "18" type: "OBJECT_CREATE" 2021-02-13T18:30:16.057 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "24" type: "OBJECT_CREATE" 2021-02-13T18:30:16.058 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "23" type: "OBJECT_CREATE" 2021-02-13T18:30:16.058 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "10" type: "OBJECT_CREATE" 2021-02-13T18:30:16.058 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "25" type: "OBJECT_CREATE" 2021-02-13T18:30:16.077 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "16" type: "OBJECT_CREATE" 2021-02-13T18:30:16.077 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "2" type: "OBJECT_CREATE" 2021-02-13T18:30:16.077 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "20" type: "OBJECT_CREATE" 2021-02-13T18:30:16.078 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "1" type: "OBJECT_CREATE" 2021-02-13T18:30:16.078 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "19" type: "OBJECT_CREATE" 2021-02-13T18:30:16.078 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "0" type: "OBJECT_CREATE" 2021-02-13T18:30:16.078 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "5" type: "OBJECT_CREATE" 2021-02-13T18:30:16.078 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "8" type: "OBJECT_CREATE" 2021-02-13T18:30:16.078 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "3" type: "OBJECT_CREATE" 2021-02-13T18:30:16.078 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "6" type: "OBJECT_CREATE" 2021-02-13T18:30:16.078 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "4" type: "OBJECT_CREATE" 2021-02-13T18:30:16.078 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "7" type: "OBJECT_CREATE" 2021-02-13T18:30:16.079 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "9" type: "OBJECT_CREATE" 2021-02-13T18:30:16.079 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "30" type: "OBJECT_CREATE" 2021-02-13T18:30:16.079 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "28" type: "OBJECT_CREATE" 2021-02-13T18:30:16.106 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "27" type: "OBJECT_CREATE" 2021-02-13T18:30:16.106 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "29" type: "OBJECT_CREATE" 2021-02-13T18:30:16.107 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "36" type: "OBJECT_CREATE" 2021-02-13T18:30:16.107 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "32" type: "OBJECT_CREATE" 2021-02-13T18:30:16.107 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "31" type: "OBJECT_CREATE" 2021-02-13T18:30:16.107 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "40" type: "OBJECT_CREATE" 2021-02-13T18:30:16.107 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "41" type: "OBJECT_CREATE" 2021-02-13T18:30:16.107 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "39" type: "OBJECT_CREATE" 2021-02-13T18:30:16.107 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "48" type: "OBJECT_CREATE" 2021-02-13T18:30:16.107 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "44" type: "OBJECT_CREATE" 2021-02-13T18:30:16.107 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "38" type: "OBJECT_CREATE" 2021-02-13T18:30:16.107 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "46" type: "OBJECT_CREATE" 2021-02-13T18:30:16.107 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "33" type: "OBJECT_CREATE" 2021-02-13T18:30:16.107 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "34" type: "OBJECT_CREATE" 2021-02-13T18:30:16.107 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "35" type: "OBJECT_CREATE" 2021-02-13T18:30:16.121 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "37" type: "OBJECT_CREATE" 2021-02-13T18:30:16.121 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "42" type: "OBJECT_CREATE" 2021-02-13T18:30:16.122 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "45" type: "OBJECT_CREATE" 2021-02-13T18:30:16.122 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "47" type: "OBJECT_CREATE" 2021-02-13T18:30:16.122 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "43" type: "OBJECT_CREATE" 2021-02-13T18:30:16.122 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "50" type: "OBJECT_CREATE" 2021-02-13T18:30:16.122 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "49" type: "OBJECT_CREATE" 2021-02-13T18:30:16.122 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "51" type: "OBJECT_CREATE" 2021-02-13T18:30:16.122 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "52" type: "OBJECT_CREATE" 2021-02-13T18:30:16.122 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "53" type: "OBJECT_CREATE" 2021-02-13T18:30:16.122 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "54" type: "OBJECT_CREATE" 2021-02-13T18:30:16.122 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "55" type: "OBJECT_CREATE" 2021-02-13T18:30:16.122 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "57" type: "OBJECT_CREATE" 2021-02-13T18:30:16.122 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "56" type: "OBJECT_CREATE" 2021-02-13T18:30:16.122 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "58" type: "OBJECT_CREATE" 2021-02-13T18:30:16.143 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "59" type: "OBJECT_CREATE" 2021-02-13T18:30:16.143 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "60" type: "OBJECT_CREATE" 2021-02-13T18:30:16.143 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "61" type: "OBJECT_CREATE" 2021-02-13T18:30:16.143 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "62" type: "OBJECT_CREATE" 2021-02-13T18:30:16.143 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "63" type: "OBJECT_CREATE" 2021-02-13T18:30:16.143 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "64" type: "OBJECT_CREATE" 2021-02-13T18:30:16.144 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "65" type: "OBJECT_CREATE" 2021-02-13T18:30:16.144 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "66" type: "OBJECT_CREATE" 2021-02-13T18:30:16.144 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "67" type: "OBJECT_CREATE" 2021-02-13T18:30:16.144 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "68" type: "OBJECT_CREATE" 2021-02-13T18:30:16.144 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "70" type: "OBJECT_CREATE" 2021-02-13T18:30:16.144 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "69" type: "OBJECT_CREATE" 2021-02-13T18:30:16.144 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "71" type: "OBJECT_CREATE" 2021-02-13T18:30:16.144 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "72" type: "OBJECT_CREATE" 2021-02-13T18:30:16.144 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "73" type: "OBJECT_CREATE" 2021-02-13T18:30:16.165 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "74" type: "OBJECT_CREATE" 2021-02-13T18:30:16.165 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "75" type: "OBJECT_CREATE" 2021-02-13T18:30:16.165 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "76" type: "OBJECT_CREATE" 2021-02-13T18:30:16.166 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "77" type: "OBJECT_CREATE" 2021-02-13T18:30:16.166 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "78" type: "OBJECT_CREATE" 2021-02-13T18:30:16.166 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "79" type: "OBJECT_CREATE" 2021-02-13T18:30:16.166 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "80" type: "OBJECT_CREATE" 2021-02-13T18:30:16.166 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "82" type: "OBJECT_CREATE" 2021-02-13T18:30:16.166 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "81" type: "OBJECT_CREATE" 2021-02-13T18:30:16.166 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "83" type: "OBJECT_CREATE" 2021-02-13T18:30:16.166 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "84" type: "OBJECT_CREATE" 2021-02-13T18:30:16.166 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "85" type: "OBJECT_CREATE" 2021-02-13T18:30:16.166 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "86" type: "OBJECT_CREATE" 2021-02-13T18:30:16.166 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "87" type: "OBJECT_CREATE" 2021-02-13T18:30:16.166 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "88" type: "OBJECT_CREATE" 2021-02-13T18:30:16.184 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "89" type: "OBJECT_CREATE" 2021-02-13T18:30:16.185 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "90" type: "OBJECT_CREATE" 2021-02-13T18:30:16.185 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "92" type: "OBJECT_CREATE" 2021-02-13T18:30:16.185 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "91" type: "OBJECT_CREATE" 2021-02-13T18:30:16.185 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "93" type: "OBJECT_CREATE" 2021-02-13T18:30:16.185 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "94" type: "OBJECT_CREATE" 2021-02-13T18:30:16.185 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "95" type: "OBJECT_CREATE" 2021-02-13T18:30:16.185 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "96" type: "OBJECT_CREATE" 2021-02-13T18:30:16.185 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "97" type: "OBJECT_CREATE" 2021-02-13T18:30:16.185 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "98" type: "OBJECT_CREATE" 2021-02-13T18:30:16.185 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "99" type: "OBJECT_CREATE" 2021-02-13T18:30:16.202 DEBUG:tasks.rgw_multi.tests_ps:superfluous events are found 2021-02-13T18:30:16.824 INFO:tasks.rgw_multisite_tests:test incremental fetching of events from a subscription ... ok 2021-02-13T18:30:16.824 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:16.825 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:16.825 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:16.885 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:30:16.899 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241016.820900_294.1","last_update":"2021-02-13 18:30:16.820900Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:30:16.900 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:30:16.900 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:16.900 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:16.900 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:17.029 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241005.341593_292.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:05.341593Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:17.029 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613241016.820900_294.1 target=1_1613241005.341593_292.1 2021-02-13T18:30:22.030 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:22.031 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:22.031 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:22.110 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241016.820900_294.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:16.820900Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:22.110 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:30:22.110 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:30:22.110 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:22.110 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:22.110 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:22.191 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241016.820900_294.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:16.820900Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:22.191 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:30:22.192 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:30:22.192 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:22.192 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:22.192 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:22.370 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241016.820900_294.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:16.820900Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:22.371 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:30:22.371 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:22.371 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:22.371 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:22.445 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:30:22.462 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241016.820900_294.1","last_update":"2021-02-13 18:30:16.820900Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:30:22.463 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:30:22.463 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:22.463 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:22.463 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:22.681 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241016.820900_294.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:16.820900Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:22.681 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:30:22.758 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:22.758 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:22.759 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:22.863 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:30:22.880 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241022.746075_298.1","last_update":"2021-02-13 18:30:22.746075Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:30:22.880 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:30:22.880 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:22.881 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:22.881 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:23.061 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241016.820900_294.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:16.820900Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:23.061 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=2 master=1_1613241022.746075_298.1 target=1_1613241016.820900_294.1 2021-02-13T18:30:28.062 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:28.062 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:28.063 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:28.247 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241022.746075_298.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:22.746075Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:28.247 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:30:28.687 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-83', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:28.687 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-83', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:28.687 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-83 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:28.784 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000020.26.5"}]} 2021-02-13T18:30:28.784 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-83 2021-02-13T18:30:28.784 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-83', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:28.784 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-83', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:28.784 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-83 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:29.006 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"7","instance":"","ns":""},"count":8},"inc_marker":{"position":"00000000020.26.5"}}}] 2021-02-13T18:30:29.006 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-83 2021-02-13T18:30:29.018 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613241028.594086.369982e6" 2021-02-13T18:30:29.018 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613241028.594528.7cdbdc0b" 2021-02-13T18:30:29.018 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613241028.594675.2ae7ac14" 2021-02-13T18:30:29.018 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613241028.594922.bd4aaed5" 2021-02-13T18:30:29.018 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613241028.595364.6d209f8c" 2021-02-13T18:30:29.018 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613241028.595800.77563b4f" 2021-02-13T18:30:29.018 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613241028.596680.c1def21b" 2021-02-13T18:30:29.018 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613241028.598215.75e4d13e" 2021-02-13T18:30:29.018 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613241028.715918.75e4d13e" 2021-02-13T18:30:29.019 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613241028.716018.ab3747df" 2021-02-13T18:30:29.019 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613241028.716139.da436819" 2021-02-13T18:30:29.025 DEBUG:tasks.rgw_multi.tests_ps:superfluous events are found 2021-02-13T18:30:29.117 DEBUG:tasks.rgw_multi.tests_ps:Event (after ack) id: "1613241028.595800.77563b4f" 2021-02-13T18:30:29.117 DEBUG:tasks.rgw_multi.tests_ps:Event (after ack) id: "1613241028.596680.c1def21b" 2021-02-13T18:30:29.117 DEBUG:tasks.rgw_multi.tests_ps:Event (after ack) id: "1613241028.598215.75e4d13e" 2021-02-13T18:30:29.117 DEBUG:tasks.rgw_multi.tests_ps:Event (after ack) id: "1613241028.715918.75e4d13e" 2021-02-13T18:30:29.117 DEBUG:tasks.rgw_multi.tests_ps:Event (after ack) id: "1613241028.716018.ab3747df" 2021-02-13T18:30:29.117 DEBUG:tasks.rgw_multi.tests_ps:Event (after ack) id: "1613241028.716139.da436819" 2021-02-13T18:30:29.383 INFO:tasks.rgw_multisite_tests:test acking of some events in a subscription ... ok 2021-02-13T18:30:29.384 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:29.384 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:29.384 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:29.480 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:30:29.494 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241029.370604_352.1","last_update":"2021-02-13 18:30:29.370604Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:30:29.494 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:30:29.495 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:29.495 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:29.495 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:29.613 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241022.746075_298.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:22.746075Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:29.613 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613241029.370604_352.1 target=1_1613241022.746075_298.1 2021-02-13T18:30:34.614 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:34.614 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:34.615 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:34.702 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241029.370604_352.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:29.370604Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:34.703 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:30:34.703 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:30:34.703 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:34.703 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:34.703 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:34.796 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241029.370604_352.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:29.370604Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:34.796 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:30:34.796 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:30:34.797 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:34.797 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:34.797 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:35.021 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241029.370604_352.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:29.370604Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:35.021 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:30:35.021 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:35.021 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:35.022 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:35.132 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:30:35.150 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241029.370604_352.1","last_update":"2021-02-13 18:30:29.370604Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:30:35.150 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:30:35.151 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:35.151 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:35.151 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:35.331 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241029.370604_352.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:29.370604Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:35.331 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:30:35.384 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:35.385 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:35.385 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:35.444 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:30:35.462 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241035.381469_358.1","last_update":"2021-02-13 18:30:35.381469Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:30:35.462 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:30:35.462 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:35.463 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:35.463 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:35.683 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241035.358498_355.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:35.358498Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:35.683 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=2 master=1_1613241035.381469_358.1 target=1_1613241035.358498_355.1 2021-02-13T18:30:40.685 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:40.685 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:40.685 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:40.871 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241035.381469_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:35.381469Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:40.872 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:30:41.271 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-84', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:41.271 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-84', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:41.272 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-84 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:41.398 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000013.12.5"}]} 2021-02-13T18:30:41.398 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-84 2021-02-13T18:30:41.399 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-84', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:41.399 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-84', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:41.399 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-84 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:41.588 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:30:41.589 WARNING:rgw_multi.tests:bucket fggivf-84 zone test-zone4 behind zone test-zone1: shard=0 master=00000000013.12.5 target= 2021-02-13T18:30:46.590 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-84', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:46.590 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-84', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:46.591 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-84 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:46.771 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"put","instance":"","ns":""},"count":3},"inc_marker":{"position":"0#00000000013.12.5"}}}] 2021-02-13T18:30:46.772 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-84 2021-02-13T18:30:46.775 DEBUG:tasks.rgw_multi.tests_ps:Event key: "copy" type: "OBJECT_CREATE" 2021-02-13T18:30:46.775 DEBUG:tasks.rgw_multi.tests_ps:Event key: "multipart" type: "OBJECT_CREATE" 2021-02-13T18:30:46.775 DEBUG:tasks.rgw_multi.tests_ps:Event key: "put" type: "OBJECT_CREATE" 2021-02-13T18:30:46.890 INFO:tasks.rgw_multisite_tests:test object creation notifications in using put/copy/post ... ok 2021-02-13T18:30:46.891 INFO:tasks.rgw_multisite_tests:test object creation s3 notifications in using put/copy/post on master ... ok 2021-02-13T18:30:46.891 INFO:tasks.rgw_multisite_tests:test multipart object upload on master ... ok 2021-02-13T18:30:46.891 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:46.892 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:46.892 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:46.992 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:30:47.011 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241046.877798_360.1","last_update":"2021-02-13 18:30:46.877798Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:30:47.011 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:30:47.011 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:47.011 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:47.011 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:47.092 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241035.381469_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:35.381469Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:47.093 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613241046.877798_360.1 target=1_1613241035.381469_358.1 2021-02-13T18:30:52.094 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:52.094 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:52.094 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:52.178 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241046.877798_360.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:46.877798Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:52.178 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:30:52.179 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:30:52.179 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:52.179 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:52.179 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:52.268 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241046.877798_360.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:46.877798Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:52.268 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:30:52.269 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:30:52.269 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:52.269 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:52.269 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:52.455 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241046.877798_360.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:46.877798Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:52.455 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:30:52.456 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:52.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:52.456 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:52.564 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:30:52.580 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241046.877798_360.1","last_update":"2021-02-13 18:30:46.877798Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:30:52.580 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:30:52.581 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:52.581 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:52.581 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:52.762 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241046.877798_360.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:46.877798Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:52.762 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:30:52.884 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:52.884 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:52.885 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:52.980 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:30:52.997 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241052.877137_367.1","last_update":"2021-02-13 18:30:52.877137Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:30:52.998 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:30:52.998 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:52.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:52.998 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:53.223 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241052.805709_361.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:52.805709Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:53.223 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=2 master=1_1613241052.877137_367.1 target=1_1613241052.805709_361.1 2021-02-13T18:30:58.224 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:58.225 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:58.225 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:58.405 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241052.877137_367.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:52.877137Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:30:58.406 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:30:58.611 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:58.611 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:58.611 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-85 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:58.731 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000007.25.11"}]} 2021-02-13T18:30:58.731 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-85 2021-02-13T18:30:58.731 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:58.732 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:58.732 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:58.953 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:30:58.953 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone1: shard=0 master=00000000007.25.11 target= 2021-02-13T18:31:03.954 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:03.954 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:03.955 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:04.144 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"foo","instance":"yXRgcW4vi6t-tWGwPXIZwrKhQSj2PVq","ns":""},"count":1},"inc_marker":{"position":"0#00000000007.25.11"}}}] 2021-02-13T18:31:04.145 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-85 2021-02-13T18:31:04.279 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:04.279 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:04.279 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-85 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:04.398 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000014.41.5"}]} 2021-02-13T18:31:04.398 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-85 2021-02-13T18:31:04.398 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:04.398 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:04.399 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:04.578 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"foo","instance":"yXRgcW4vi6t-tWGwPXIZwrKhQSj2PVq","ns":""},"count":1},"inc_marker":{"position":"0#00000000007.25.11"}}}] 2021-02-13T18:31:04.579 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone1: shard=0 master=00000000014.41.5 target=00000000007.25.11 2021-02-13T18:31:09.580 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:09.580 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:09.580 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:09.764 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"foo","instance":"yXRgcW4vi6t-tWGwPXIZwrKhQSj2PVq","ns":""},"count":1},"inc_marker":{"position":"00000000014.41.5"}}}] 2021-02-13T18:31:09.765 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-85 2021-02-13T18:31:09.768 DEBUG:tasks.rgw_multi.tests_ps:Event key: "foo" type: "OBJECT_DELETE" 2021-02-13T18:31:09.769 DEBUG:tasks.rgw_multi.tests_ps:Event key: "foo" type: "OBJECT_DELETE" 2021-02-13T18:31:09.769 DEBUG:tasks.rgw_multi.tests_ps:Event key: "foo" type: "OBJECT_DELETE" 2021-02-13T18:31:09.772 DEBUG:tasks.rgw_multi.tests_ps:Event key: "foo" type: "DELETE_MARKER_CREATE" 2021-02-13T18:31:09.772 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:09.773 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:09.773 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-85 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:09.861 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000014.41.5"}]} 2021-02-13T18:31:09.861 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-85 2021-02-13T18:31:09.862 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:09.862 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:09.862 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:09.987 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"foo","instance":"yXRgcW4vi6t-tWGwPXIZwrKhQSj2PVq","ns":""},"count":1},"inc_marker":{"position":"00000000014.41.5"}}}] 2021-02-13T18:31:09.988 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=fggivf-85 2021-02-13T18:31:09.988 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:09.988 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:09.988 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-85 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:10.079 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000014.41.5"}]} 2021-02-13T18:31:10.079 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-85 2021-02-13T18:31:10.079 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:10.079 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:10.080 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-85 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:10.178 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"foo","instance":"yXRgcW4vi6t-tWGwPXIZwrKhQSj2PVq","ns":""},"count":1},"inc_marker":{"position":"00000000014.41.5"}}}] 2021-02-13T18:31:10.179 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=fggivf-85 2021-02-13T18:31:10.179 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:10.179 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:10.179 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-85 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:10.281 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000014.41.5"}]} 2021-02-13T18:31:10.281 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-85 2021-02-13T18:31:10.281 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:10.281 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:10.281 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:10.468 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"foo","instance":"yXRgcW4vi6t-tWGwPXIZwrKhQSj2PVq","ns":""},"count":1},"inc_marker":{"position":"00000000014.41.5"}}}] 2021-02-13T18:31:10.468 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-85 2021-02-13T18:31:10.468 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:10.469 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:10.469 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:10.551 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000012.38.5"}]} 2021-02-13T18:31:10.551 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-85 2021-02-13T18:31:10.551 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:10.551 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:10.552 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:10.679 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"foo","instance":"yXRgcW4vi6t-tWGwPXIZwrKhQSj2PVq","ns":""},"count":1},"inc_marker":{"position":"00000000012.38.5"}}}] 2021-02-13T18:31:10.679 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=fggivf-85 2021-02-13T18:31:10.679 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:10.680 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:10.680 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:10.801 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000012.38.5"}]} 2021-02-13T18:31:10.802 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-85 2021-02-13T18:31:10.802 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:10.802 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:10.802 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:10.925 INFO:teuthology.orchestra.run.gibba037.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"foo","instance":"yXRgcW4vi6t-tWGwPXIZwrKhQSj2PVq","ns":""},"count":1},"inc_marker":{"position":"00000000012.38.5"}}}] 2021-02-13T18:31:10.926 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=fggivf-85 2021-02-13T18:31:10.926 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:10.926 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:10.926 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:11.013 INFO:teuthology.orchestra.run.gibba038.stdout:{"markers":[{"key":0,"val":"00000000012.38.5"}]} 2021-02-13T18:31:11.014 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=fggivf-85 2021-02-13T18:31:11.014 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:11.014 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:11.014 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:11.204 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:11.205 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:31:16.206 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:16.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:16.206 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:16.393 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:16.394 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:31:21.395 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:21.395 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:21.395 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:21.586 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:21.586 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:31:26.588 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:26.588 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:26.589 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:26.770 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:26.771 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:31:31.772 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:31.772 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:31.772 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:31.962 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:31.962 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:31:36.963 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:36.963 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:36.964 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:37.151 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:37.151 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:31:42.152 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:42.152 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:42.152 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:42.340 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:42.340 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:31:47.341 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:47.341 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:47.342 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:47.531 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:47.532 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:31:52.533 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:52.533 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:52.533 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:52.722 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:52.723 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:31:57.723 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:57.879 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:57.879 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:58.063 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:58.063 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:32:03.064 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:03.064 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:03.064 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:03.251 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:03.251 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:32:08.252 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:08.252 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:08.253 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:08.434 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:08.434 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:32:13.435 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:13.436 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:13.436 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:13.622 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:13.622 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:32:18.623 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:18.624 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:18.624 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:18.812 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:18.813 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:32:23.814 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:23.814 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:23.815 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:24.004 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:24.005 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:32:29.006 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:29.006 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:29.007 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:29.195 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:29.195 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:32:34.196 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:34.196 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:34.197 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:34.384 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:34.384 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:32:39.385 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:39.386 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:39.386 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:39.574 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:39.574 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:32:44.575 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:44.575 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:44.576 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:44.764 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:44.764 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:32:49.766 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:49.766 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:49.766 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:49.955 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:49.955 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:32:54.956 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:54.956 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:54.957 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:55.147 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:55.148 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:33:00.148 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:00.149 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:00.149 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:00.336 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:00.336 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:33:05.337 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:05.338 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:05.338 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:05.528 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:05.528 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:33:10.529 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:10.529 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:10.530 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:10.713 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:10.714 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:33:15.715 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:15.715 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:15.715 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:15.905 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:15.905 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:33:20.906 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:20.907 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:20.907 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:21.094 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:21.094 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:33:26.095 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:26.095 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:26.096 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:26.285 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:26.286 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:33:31.286 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:31.287 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:31.287 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:31.470 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:31.470 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:33:36.471 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:36.471 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:36.472 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:36.657 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:36.657 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:33:41.659 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:41.659 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:41.659 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:41.844 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:41.844 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:33:46.846 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:46.846 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:46.846 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:47.028 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:47.029 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:33:52.030 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:52.030 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:52.031 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:52.212 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:52.212 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:33:57.213 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:57.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:57.215 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:57.396 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:57.397 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:34:02.398 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:02.398 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:02.399 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:02.583 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:34:02.583 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:34:07.584 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:07.584 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:07.585 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:07.775 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:34:07.775 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:34:12.782 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:12.783 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:12.783 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:12.973 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:34:12.973 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:34:17.975 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:17.975 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:17.976 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:18.165 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:34:18.165 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:34:23.166 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:23.166 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:23.166 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:23.352 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:34:23.352 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:34:28.353 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:28.353 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:28.354 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:28.544 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:34:28.545 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:34:33.546 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:33.546 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:33.546 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:33.729 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:34:33.729 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:34:38.730 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:38.730 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:38.730 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:38.921 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:34:38.921 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:34:43.922 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:43.922 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:43.922 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:44.110 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:34:44.111 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:34:49.112 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:49.112 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:49.112 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:49.301 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:34:49.301 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:34:54.302 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:54.302 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:54.302 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:54.491 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:34:54.491 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:34:59.492 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:59.492 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:59.493 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:59.675 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:34:59.675 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:35:04.676 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:04.677 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:04.677 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:35:04.857 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:35:04.858 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:35:09.859 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:09.859 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:09.859 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:35:10.049 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:35:10.049 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:35:15.050 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:15.051 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:15.051 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:35:15.238 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:35:15.238 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:35:20.239 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:20.240 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:20.240 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:35:20.423 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:35:20.424 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:35:25.425 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:25.425 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:25.425 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:35:25.606 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:35:25.606 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:35:30.607 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:30.607 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:30.607 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:35:30.796 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:35:30.797 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:35:35.798 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:35.798 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:35.799 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:35:35.984 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:35:35.985 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:35:40.986 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:40.987 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:40.987 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:35:41.168 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:35:41.168 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:35:46.170 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:46.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:46.170 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:35:46.362 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:35:46.606 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:35:51.607 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:51.608 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:51.608 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:35:51.799 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:35:51.799 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:35:56.800 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:56.800 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:56.801 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:35:56.990 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:35:56.990 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:36:01.991 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:01.992 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:01.992 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:02.173 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:36:02.174 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:36:07.174 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:07.175 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:07.175 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:07.363 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:36:07.364 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:36:12.365 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:12.365 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:12.365 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:12.548 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:36:12.548 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:36:17.549 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:17.549 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'fggivf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:17.550 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket fggivf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:17.731 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:36:17.731 WARNING:rgw_multi.tests:bucket fggivf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.38.5 target= 2021-02-13T18:36:22.732 DEBUG:tasks.rgw_multi.tests_ps:zonegroup_bucket_checkpoint failed, cannot delete bucket 2021-02-13T18:36:22.837 INFO:tasks.rgw_multisite_tests:test notification of deletion markers ... ok 2021-02-13T18:36:22.838 INFO:tasks.rgw_multisite_tests:test s3 notification of metadata on master ... ok 2021-02-13T18:36:22.838 INFO:tasks.rgw_multisite_tests:test s3 notification of tags on master ... ok 2021-02-13T18:36:22.838 INFO:tasks.rgw_multisite_tests:test s3 notification of object versions ... ok 2021-02-13T18:36:22.839 INFO:tasks.rgw_multisite_tests:test s3 notification of deletion markers on master ... ok 2021-02-13T18:36:22.839 INFO:tasks.rgw_multisite_tests:test pushing to http endpoint ... ok 2021-02-13T18:36:22.839 INFO:tasks.rgw_multisite_tests:test pushing to http endpoint s3 record format ... ok 2021-02-13T18:36:22.839 INFO:tasks.rgw_multisite_tests:test pushing to amqp endpoint ... ok 2021-02-13T18:36:22.839 INFO:tasks.rgw_multisite_tests:test pushing to amqp endpoint s3 record format ... ok 2021-02-13T18:36:22.840 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:22.840 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:22.840 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:22.905 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:36:22.922 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241052.877137_367.1","last_update":"2021-02-13 18:30:52.877137Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:36:22.922 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:36:22.922 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:22.923 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:22.923 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:23.045 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241052.877137_367.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:52.877137Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:36:23.046 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:36:23.046 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:36:23.046 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:23.046 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:23.046 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:23.141 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241052.877137_367.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:52.877137Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:36:23.141 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:36:23.141 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:36:23.141 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:23.142 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:23.142 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:23.361 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241052.877137_367.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:52.877137Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:36:23.361 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:36:23.361 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:23.361 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:23.362 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:23.430 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:36:23.453 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241052.877137_367.1","last_update":"2021-02-13 18:30:52.877137Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:36:23.454 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:36:23.454 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:23.454 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:23.454 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:23.636 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241052.877137_367.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:52.877137Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:36:23.637 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:36:23.713 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:23.713 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:23.714 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:23.815 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:36:23.833 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241383.700587_385.1","last_update":"2021-02-13 18:36:23.700587Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:36:23.833 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:36:23.833 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:23.833 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:23.834 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:24.012 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241052.877137_367.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:30:52.877137Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:36:24.013 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=2 master=1_1613241383.700587_385.1 target=1_1613241052.877137_367.1 2021-02-13T18:36:29.014 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:29.014 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:29.015 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:29.193 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241383.700587_385.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:36:23.700587Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:36:29.193 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:36:29.675 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-86', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:29.675 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-86', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:29.675 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-86 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:29.801 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000020.39.5"}]} 2021-02-13T18:36:29.801 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-86 2021-02-13T18:36:29.801 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-86', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:29.801 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-86', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:29.802 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-86 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:29.988 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:36:29.989 WARNING:rgw_multi.tests:bucket fggivf-86 zone test-zone4 behind zone test-zone1: shard=0 master=00000000020.39.5 target= 2021-02-13T18:36:34.990 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-86', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:34.991 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-86', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:34.991 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-86 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:35.178 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"9","instance":"","ns":""},"count":10},"inc_marker":{"position":"0#00000000020.39.5"}}}] 2021-02-13T18:36:35.178 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-86 2021-02-13T18:36:35.361 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-86', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:35.361 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'fggivf-86', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:35.362 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket fggivf-86 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:35.474 INFO:teuthology.orchestra.run.gibba037.stdout:{"markers":[{"key":0,"val":"00000000040.59.5"}]} 2021-02-13T18:36:35.474 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-86 2021-02-13T18:36:35.474 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-86', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:35.474 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-86', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:35.475 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-86 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:35.663 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"9","instance":"","ns":""},"count":10},"inc_marker":{"position":"0#00000000020.39.5"}}}] 2021-02-13T18:36:35.664 WARNING:rgw_multi.tests:bucket fggivf-86 zone test-zone4 behind zone test-zone1: shard=0 master=00000000040.59.5 target=00000000020.39.5 2021-02-13T18:36:40.664 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-86', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:40.665 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'fggivf-86', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:40.665 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket fggivf-86 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:40.846 INFO:teuthology.orchestra.run.gibba038.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"9","instance":"","ns":""},"count":10},"inc_marker":{"position":"00000000040.59.5"}}}] 2021-02-13T18:36:40.847 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=fggivf-86 2021-02-13T18:36:40.892 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:40.892 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:40.892 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:40.999 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:36:41.016 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241400.879374_387.1","last_update":"2021-02-13 18:36:40.879374Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:36:41.017 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:36:41.017 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:41.017 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:41.017 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:41.203 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241383.700587_385.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:36:23.700587Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:36:41.203 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=2 master=1_1613241400.879374_387.1 target=1_1613241383.700587_385.1 2021-02-13T18:36:46.204 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:46.204 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:46.205 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:46.393 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241400.879374_387.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:36:40.879374Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:36:46.393 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:36:46.402 WARNING:tasks.rgw_multi.tests_ps:superfluous records are found 2021-02-13T18:36:46.448 INFO:tasks.rgw_multisite_tests:test notification status upon bucket deletion ... ok 2021-02-13T18:36:46.449 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:46.449 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:46.449 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:46.521 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:36:46.538 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241400.879374_387.1","last_update":"2021-02-13 18:36:40.879374Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:36:46.538 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:36:46.538 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:46.539 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:46.539 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:46.664 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241400.879374_387.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:36:40.879374Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:36:46.664 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:36:46.664 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:36:46.664 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:46.664 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:46.665 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:46.747 INFO:teuthology.orchestra.run.gibba037.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241400.879374_387.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:36:40.879374Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:36:46.748 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:36:46.748 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:36:46.748 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:46.748 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:46.748 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:46.971 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241400.879374_387.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:36:40.879374Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:36:46.972 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:36:46.972 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:46.972 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:46.972 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:47.047 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:36:47.063 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241400.879374_387.1","last_update":"2021-02-13 18:36:40.879374Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:36:47.063 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:36:47.063 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:47.064 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:47.064 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:47.252 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241400.879374_387.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:36:40.879374Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:36:47.252 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:36:47.318 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:47.318 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:47.318 DEBUG:teuthology.orchestra.run.gibba037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:47.423 INFO:teuthology.orchestra.run.gibba037.stderr:No --period given, using current period=595e1dd1-4688-4d03-af39-72f8737fa57e 2021-02-13T18:36:47.440 INFO:teuthology.orchestra.run.gibba037.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241407.305300_391.1","last_update":"2021-02-13 18:36:47.305300Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:36:47.440 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:36:47.440 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:47.440 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:47.441 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:47.663 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241400.879374_387.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:36:40.879374Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:36:47.664 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=2 master=1_1613241407.305300_391.1 target=1_1613241400.879374_387.1 2021-02-13T18:36:52.665 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:52.665 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:52.666 DEBUG:teuthology.orchestra.run.gibba038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:52.847 INFO:teuthology.orchestra.run.gibba038.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"595e1dd1-4688-4d03-af39-72f8737fa57e","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613236014.104172_63.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:06:54.104172Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613241407.305300_391.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:36:47.305300Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1613236165.569853_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:09:25.569853Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:36:52.848 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:36:52.865 INFO:tasks.rgw_multi.tests_ps:missing topic is expected 2021-02-13T18:36:52.908 INFO:tasks.rgw_multisite_tests:test creating a subscription when no topic info exists ... ok 2021-02-13T18:36:52.909 INFO:tasks.rgw_multisite_tests:test updating topic associated with a notification ... ok 2021-02-13T18:36:52.910 INFO:tasks.rgw_multisite_tests:test updating the topic of a notification ... ok 2021-02-13T18:36:52.910 INFO:tasks.rgw_multisite_tests:test notification creation with multiple topics ... ok 2021-02-13T18:36:52.910 INFO:tasks.rgw_multisite_tests: 2021-02-13T18:36:52.911 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T18:36:52.911 INFO:tasks.rgw_multisite_tests:Ran 45 tests in 532.349s 2021-02-13T18:36:52.911 INFO:tasks.rgw_multisite_tests: 2021-02-13T18:36:52.911 INFO:tasks.rgw_multisite_tests:OK 2021-02-13T18:36:52.912 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/task/__init__.py", line 123, in __enter__ self.begin() File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multisite_tests.py", line 74, in begin raise RuntimeError(error_msg + 'test failures') RuntimeError: rgw multisite, test failures 2021-02-13T18:36:53.061 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=b537f831566949f09f0e4780e2ad87d0 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/task/__init__.py", line 123, in __enter__ self.begin() File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multisite_tests.py", line 74, in begin raise RuntimeError(error_msg + 'test failures') RuntimeError: rgw multisite, test failures 2021-02-13T18:36:53.062 DEBUG:teuthology.run_tasks:Unwinding manager rgw-multisite-tests 2021-02-13T18:36:53.074 DEBUG:teuthology.run_tasks:Unwinding manager rgw-multisite 2021-02-13T18:36:53.116 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2021-02-13T18:36:53.132 DEBUG:tasks.rgw.c1.client.0:waiting for process to exit 2021-02-13T18:36:53.132 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T18:36:53.153 INFO:tasks.rgw.c1.client.0.gibba037.stdout:2021-02-13 18:36:53.128 7f23ee000700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 17226) UID: 0 2021-02-13T18:36:53.153 INFO:tasks.rgw.c1.client.0.gibba037.stdout:2021-02-13 18:36:53.128 7f2404947980 -1 shutting down 2021-02-13T18:36:59.235 INFO:tasks.rgw.c1.client.0:Stopped 2021-02-13T18:36:59.235 DEBUG:teuthology.orchestra.run.gibba037:> rm -f /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock 2021-02-13T18:36:59.243 DEBUG:tasks.rgw.c1.client.1:waiting for process to exit 2021-02-13T18:36:59.243 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T18:36:59.284 INFO:tasks.rgw.c1.client.1.gibba037.stdout:2021-02-13 18:36:59.280 7f7100697700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 25884) UID: 0 2021-02-13T18:36:59.285 INFO:tasks.rgw.c1.client.1.gibba037.stdout:2021-02-13 18:36:59.280 7f7116fde980 -1 shutting down 2021-02-13T18:37:05.345 INFO:tasks.rgw.c1.client.1:Stopped 2021-02-13T18:37:05.346 DEBUG:teuthology.orchestra.run.gibba037:> rm -f /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock 2021-02-13T18:37:05.354 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2021-02-13T18:37:05.354 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T18:37:05.356 INFO:tasks.rgw.c2.client.0.gibba038.stdout:2021-02-13 18:37:05.349 7ff2a134e700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 17135) UID: 0 2021-02-13T18:37:05.356 INFO:tasks.rgw.c2.client.0.gibba038.stdout:2021-02-13 18:37:05.349 7ff2b7c95980 -1 shutting down 2021-02-13T18:37:11.456 INFO:tasks.rgw.c2.client.0:Stopped 2021-02-13T18:37:11.457 DEBUG:teuthology.orchestra.run.gibba038:> rm -f /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock 2021-02-13T18:37:11.466 DEBUG:tasks.rgw.c2.client.1:waiting for process to exit 2021-02-13T18:37:11.466 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T18:37:11.512 INFO:tasks.rgw.c2.client.1.gibba038.stdout:2021-02-13 18:37:11.509 7f688cf18700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 18192) UID: 0 2021-02-13T18:37:11.513 INFO:tasks.rgw.c2.client.1.gibba038.stdout:2021-02-13 18:37:11.509 7f68a385f980 -1 shutting down 2021-02-13T18:37:17.568 INFO:tasks.rgw.c2.client.1:Stopped 2021-02-13T18:37:17.568 DEBUG:teuthology.orchestra.run.gibba038:> rm -f /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock 2021-02-13T18:37:17.577 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2021-02-13T18:37:17.595 INFO:tasks.ceph.ceph_manager.c2:Canceling any pending splits or merges... 2021-02-13T18:37:17.595 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 osd dump --format=json 2021-02-13T18:37:17.775 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-02-13T18:37:17.775 INFO:teuthology.orchestra.run.gibba038.stdout:{"epoch":55,"fsid":"9862e2e1-3629-4a37-b410-fe5ad22a1229","created":"2021-02-13 17:05:21.399671","modified":"2021-02-13 18:00:20.690515","last_up_change":"2021-02-13 17:05:26.487426","last_in_change":"2021-02-13 17:05:26.487426","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-13 17:05:29.735450","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"default.rgw.buckets.data","create_time":"2021-02-13 17:05:40.855411","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"default.rgw.buckets.index","create_time":"2021-02-13 17:05:42.197626","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":".rgw.root","create_time":"2021-02-13 17:05:53.536587","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2021-02-13 17:05:54.636692","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2021-02-13 17:05:56.631516","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":7,"pool_name":"default.rgw.log","create_time":"2021-02-13 17:05:58.631691","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":8,"pool_name":"test-zone2.rgw.buckets.data","create_time":"2021-02-13 17:06:12.411269","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":9,"pool_name":"test-zone2.rgw.control","create_time":"2021-02-13 17:06:13.734388","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":10,"pool_name":"test-zone2.rgw.meta","create_time":"2021-02-13 17:06:15.615141","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":11,"pool_name":"test-zone2.rgw.log","create_time":"2021-02-13 17:06:17.603923","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":12,"pool_name":"test-zone4.rgw.buckets.data","create_time":"2021-02-13 17:06:37.773159","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":13,"pool_name":"test-zone4.rgw.control","create_time":"2021-02-13 17:06:39.776860","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":14,"pool_name":"test-zone4.rgw.meta","create_time":"2021-02-13 17:06:41.624773","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":15,"pool_name":"test-zone4.rgw.log","create_time":"2021-02-13 17:06:43.614067","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":16,"pool_name":"test-zone2.rgw.buckets.index","create_time":"2021-02-13 17:08:53.267166","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":17,"pool_name":"test-zone4.rgw.buckets.index","create_time":"2021-02-13 17:08:53.471279","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":18,"pool_name":"remove.rgw.control","create_time":"2021-02-13 18:00:14.448167","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":19,"pool_name":"remove.rgw.meta","create_time":"2021-02-13 18:00:15.685426","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":20,"pool_name":"remove.rgw.log","create_time":"2021-02-13 18:00:17.678640","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"071ed5f1-52ee-49d1-8385-810f302f85a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6800","nonce":14244},{"type":"v1","addr":"172.21.2.138:6801","nonce":14244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6802","nonce":14244},{"type":"v1","addr":"172.21.2.138:6803","nonce":14244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6808","nonce":14244},{"type":"v1","addr":"172.21.2.138:6810","nonce":14244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6804","nonce":14244},{"type":"v1","addr":"172.21.2.138:6806","nonce":14244}]},"public_addr":"172.21.2.138:6801/14244","cluster_addr":"172.21.2.138:6803/14244","heartbeat_back_addr":"172.21.2.138:6810/14244","heartbeat_front_addr":"172.21.2.138:6806/14244","state":["exists","up"]},{"osd":1,"uuid":"2842cc8e-04a5-415b-9635-a8fa91816c5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6816","nonce":14245},{"type":"v1","addr":"172.21.2.138:6817","nonce":14245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6818","nonce":14245},{"type":"v1","addr":"172.21.2.138:6819","nonce":14245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6822","nonce":14245},{"type":"v1","addr":"172.21.2.138:6823","nonce":14245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6820","nonce":14245},{"type":"v1","addr":"172.21.2.138:6821","nonce":14245}]},"public_addr":"172.21.2.138:6817/14245","cluster_addr":"172.21.2.138:6819/14245","heartbeat_back_addr":"172.21.2.138:6823/14245","heartbeat_front_addr":"172.21.2.138:6821/14245","state":["exists","up"]},{"osd":2,"uuid":"ee3f40ad-6deb-45ad-8034-b96f1d263346","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6805","nonce":14246},{"type":"v1","addr":"172.21.2.138:6807","nonce":14246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6809","nonce":14246},{"type":"v1","addr":"172.21.2.138:6811","nonce":14246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6814","nonce":14246},{"type":"v1","addr":"172.21.2.138:6815","nonce":14246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.138:6812","nonce":14246},{"type":"v1","addr":"172.21.2.138:6813","nonce":14246}]},"public_addr":"172.21.2.138:6807/14246","cluster_addr":"172.21.2.138:6811/14246","heartbeat_back_addr":"172.21.2.138:6815/14246","heartbeat_front_addr":"172.21.2.138:6813/14246","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T18:37:17.784 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --cluster c2 --mon-client-directed-command-retry 5 tell mon.* injectargs -- --no-mon-health-to-clog 2021-02-13T18:37:17.943 INFO:teuthology.orchestra.run.gibba038.stderr:injectargs:mon_health_to_clog = 'false' 2021-02-13T18:37:17.955 INFO:teuthology.misc:Shutting down mds daemons... 2021-02-13T18:37:17.955 INFO:teuthology.misc:Shutting down osd daemons... 2021-02-13T18:37:17.955 DEBUG:tasks.ceph.c2.osd.0:waiting for process to exit 2021-02-13T18:37:17.955 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T18:37:24.058 INFO:tasks.ceph.c2.osd.0:Stopped 2021-02-13T18:37:24.058 DEBUG:tasks.ceph.c2.osd.1:waiting for process to exit 2021-02-13T18:37:24.058 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T18:37:24.139 INFO:tasks.ceph.c2.osd.1:Stopped 2021-02-13T18:37:24.140 DEBUG:tasks.ceph.c2.osd.2:waiting for process to exit 2021-02-13T18:37:24.140 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T18:37:24.227 INFO:tasks.ceph.c2.osd.2:Stopped 2021-02-13T18:37:24.228 INFO:teuthology.misc:Shutting down mgr daemons... 2021-02-13T18:37:24.228 DEBUG:tasks.ceph.c2.mgr.x:waiting for process to exit 2021-02-13T18:37:24.228 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T18:37:24.239 INFO:tasks.ceph.c2.mgr.x:Stopped 2021-02-13T18:37:24.239 INFO:teuthology.misc:Shutting down mon daemons... 2021-02-13T18:37:24.239 DEBUG:tasks.ceph.c2.mon.a:waiting for process to exit 2021-02-13T18:37:24.239 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T18:37:24.297 INFO:tasks.ceph.c2.mon.a:Stopped 2021-02-13T18:37:24.298 INFO:tasks.ceph:Checking cluster log for badness... 2021-02-13T18:37:24.298 DEBUG:teuthology.orchestra.run.gibba038:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c2.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2021-02-13T18:37:24.351 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-0 on ubuntu@gibba038.front.sepia.ceph.com 2021-02-13T18:37:24.351 DEBUG:teuthology.orchestra.run.gibba038:> sync && sudo umount -f /var/lib/ceph/osd/c2-0 2021-02-13T18:37:24.802 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-1 on ubuntu@gibba038.front.sepia.ceph.com 2021-02-13T18:37:24.803 DEBUG:teuthology.orchestra.run.gibba038:> sync && sudo umount -f /var/lib/ceph/osd/c2-1 2021-02-13T18:37:24.918 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-2 on ubuntu@gibba038.front.sepia.ceph.com 2021-02-13T18:37:24.918 DEBUG:teuthology.orchestra.run.gibba038:> sync && sudo umount -f /var/lib/ceph/osd/c2-2 2021-02-13T18:37:25.045 INFO:tasks.ceph:Archiving mon data... 2021-02-13T18:37:25.046 DEBUG:teuthology.misc:Transferring archived files from gibba038:/var/lib/ceph/mon/c2-a to /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877897/data/c2.mon.a.tgz 2021-02-13T18:37:25.046 DEBUG:teuthology.orchestra.run.gibba038:> mktemp 2021-02-13T18:37:25.054 INFO:teuthology.orchestra.run.gibba038.stdout:/tmp/tmp.euoakuxgC2 2021-02-13T18:37:25.054 DEBUG:teuthology.orchestra.run.gibba038:> sudo tar cz -f - -C /var/lib/ceph/mon/c2-a -- . > /tmp/tmp.euoakuxgC2 2021-02-13T18:37:25.355 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 0666 /tmp/tmp.euoakuxgC2 2021-02-13T18:37:25.418 DEBUG:teuthology.orchestra.remote:gibba038:/tmp/tmp.euoakuxgC2 is 1MB 2021-02-13T18:37:25.543 DEBUG:teuthology.orchestra.run.gibba038:> rm -fr /tmp/tmp.euoakuxgC2 2021-02-13T18:37:25.551 INFO:tasks.ceph:Cleaning ceph cluster... 2021-02-13T18:37:25.552 DEBUG:teuthology.orchestra.run.gibba037:> sudo rm -rf -- /etc/ceph/c2.conf /etc/ceph/c2.keyring /home/ubuntu/cephtest/c2.data /home/ubuntu/cephtest/c2.monmap /home/ubuntu/cephtest/../*.pid 2021-02-13T18:37:25.555 DEBUG:teuthology.orchestra.run.gibba038:> sudo rm -rf -- /etc/ceph/c2.conf /etc/ceph/c2.keyring /home/ubuntu/cephtest/c2.data /home/ubuntu/cephtest/c2.monmap /home/ubuntu/cephtest/../*.pid 2021-02-13T18:37:25.598 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2021-02-13T18:37:25.611 INFO:tasks.ceph.ceph_manager.c1:Canceling any pending splits or merges... 2021-02-13T18:37:25.612 DEBUG:teuthology.orchestra.run.gibba037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 osd dump --format=json 2021-02-13T18:37:25.773 INFO:teuthology.orchestra.run.gibba037.stdout: 2021-02-13T18:37:25.773 INFO:teuthology.orchestra.run.gibba037.stdout:{"epoch":53,"fsid":"611a710d-9f14-45ea-aab7-0ffef279fb6a","created":"2021-02-13 17:04:56.556157","modified":"2021-02-13 18:17:19.147819","last_up_change":"2021-02-13 17:05:01.585621","last_in_change":"2021-02-13 17:05:01.585621","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-13 17:05:04.769870","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"default.rgw.buckets.data","create_time":"2021-02-13 17:05:35.637964","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"default.rgw.buckets.index","create_time":"2021-02-13 17:05:36.841533","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":".rgw.root","create_time":"2021-02-13 17:05:46.038718","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2021-02-13 17:05:47.136573","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2021-02-13 17:05:49.135587","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":7,"pool_name":"default.rgw.log","create_time":"2021-02-13 17:05:51.133846","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":8,"pool_name":"test-zone1.rgw.buckets.data","create_time":"2021-02-13 17:06:02.749659","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":9,"pool_name":"test-zone1.rgw.control","create_time":"2021-02-13 17:06:04.854568","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":10,"pool_name":"test-zone1.rgw.meta","create_time":"2021-02-13 17:06:06.715138","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":11,"pool_name":"test-zone1.rgw.log","create_time":"2021-02-13 17:06:08.708414","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":12,"pool_name":"test-zone3.rgw.buckets.data","create_time":"2021-02-13 17:06:28.110726","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":13,"pool_name":"test-zone3.rgw.control","create_time":"2021-02-13 17:06:29.390673","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":14,"pool_name":"test-zone3.rgw.meta","create_time":"2021-02-13 17:06:31.213279","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":15,"pool_name":"test-zone3.rgw.log","create_time":"2021-02-13 17:06:33.209973","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":16,"pool_name":"test-zone1.rgw.buckets.index","create_time":"2021-02-13 17:08:52.114611","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":17,"pool_name":"test-zone3.rgw.buckets.index","create_time":"2021-02-13 17:08:54.296593","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":18,"pool_name":"test-zone1.rgw.buckets.non-ec","create_time":"2021-02-13 18:17:16.239804","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"2dfed3f8-f109-4075-96c1-9af5f342c4dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6800","nonce":14263},{"type":"v1","addr":"172.21.2.137:6801","nonce":14263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6802","nonce":14263},{"type":"v1","addr":"172.21.2.137:6803","nonce":14263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6806","nonce":14263},{"type":"v1","addr":"172.21.2.137:6807","nonce":14263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6804","nonce":14263},{"type":"v1","addr":"172.21.2.137:6805","nonce":14263}]},"public_addr":"172.21.2.137:6801/14263","cluster_addr":"172.21.2.137:6803/14263","heartbeat_back_addr":"172.21.2.137:6807/14263","heartbeat_front_addr":"172.21.2.137:6805/14263","state":["exists","up"]},{"osd":1,"uuid":"661cb094-69c9-46f5-83e9-4045725f472d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6808","nonce":14264},{"type":"v1","addr":"172.21.2.137:6809","nonce":14264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6810","nonce":14264},{"type":"v1","addr":"172.21.2.137:6811","nonce":14264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6814","nonce":14264},{"type":"v1","addr":"172.21.2.137:6815","nonce":14264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6812","nonce":14264},{"type":"v1","addr":"172.21.2.137:6813","nonce":14264}]},"public_addr":"172.21.2.137:6809/14264","cluster_addr":"172.21.2.137:6811/14264","heartbeat_back_addr":"172.21.2.137:6815/14264","heartbeat_front_addr":"172.21.2.137:6813/14264","state":["exists","up"]},{"osd":2,"uuid":"4052384f-9f5d-4059-88e4-328e529c5898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6816","nonce":14265},{"type":"v1","addr":"172.21.2.137:6817","nonce":14265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6818","nonce":14265},{"type":"v1","addr":"172.21.2.137:6819","nonce":14265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6822","nonce":14265},{"type":"v1","addr":"172.21.2.137:6823","nonce":14265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.137:6820","nonce":14265},{"type":"v1","addr":"172.21.2.137:6821","nonce":14265}]},"public_addr":"172.21.2.137:6817/14265","cluster_addr":"172.21.2.137:6819/14265","heartbeat_back_addr":"172.21.2.137:6823/14265","heartbeat_front_addr":"172.21.2.137:6821/14265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T18:37:25.782 DEBUG:teuthology.orchestra.run.gibba037:> sudo ceph --cluster c1 --mon-client-directed-command-retry 5 tell mon.* injectargs -- --no-mon-health-to-clog 2021-02-13T18:37:25.940 INFO:teuthology.orchestra.run.gibba037.stderr:injectargs:mon_health_to_clog = 'false' 2021-02-13T18:37:25.950 INFO:teuthology.misc:Shutting down mds daemons... 2021-02-13T18:37:25.950 INFO:teuthology.misc:Shutting down osd daemons... 2021-02-13T18:37:25.950 DEBUG:tasks.ceph.c1.osd.0:waiting for process to exit 2021-02-13T18:37:25.950 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T18:37:26.045 INFO:tasks.ceph.c1.osd.0:Stopped 2021-02-13T18:37:26.046 DEBUG:tasks.ceph.c1.osd.1:waiting for process to exit 2021-02-13T18:37:26.046 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T18:37:26.132 INFO:tasks.ceph.c1.osd.1:Stopped 2021-02-13T18:37:26.132 DEBUG:tasks.ceph.c1.osd.2:waiting for process to exit 2021-02-13T18:37:26.132 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T18:37:26.211 INFO:tasks.ceph.c1.osd.2:Stopped 2021-02-13T18:37:26.211 INFO:teuthology.misc:Shutting down mgr daemons... 2021-02-13T18:37:26.211 DEBUG:tasks.ceph.c1.mgr.x:waiting for process to exit 2021-02-13T18:37:26.211 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T18:37:26.222 INFO:tasks.ceph.c1.mgr.x:Stopped 2021-02-13T18:37:26.222 INFO:teuthology.misc:Shutting down mon daemons... 2021-02-13T18:37:26.222 DEBUG:tasks.ceph.c1.mon.a:waiting for process to exit 2021-02-13T18:37:26.222 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T18:37:26.275 INFO:tasks.ceph.c1.mon.a:Stopped 2021-02-13T18:37:26.276 INFO:tasks.ceph:Checking cluster log for badness... 2021-02-13T18:37:26.276 DEBUG:teuthology.orchestra.run.gibba037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c1.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2021-02-13T18:37:26.326 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-0 on ubuntu@gibba037.front.sepia.ceph.com 2021-02-13T18:37:26.326 DEBUG:teuthology.orchestra.run.gibba037:> sync && sudo umount -f /var/lib/ceph/osd/c1-0 2021-02-13T18:37:26.541 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-1 on ubuntu@gibba037.front.sepia.ceph.com 2021-02-13T18:37:26.541 DEBUG:teuthology.orchestra.run.gibba037:> sync && sudo umount -f /var/lib/ceph/osd/c1-1 2021-02-13T18:37:26.666 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-2 on ubuntu@gibba037.front.sepia.ceph.com 2021-02-13T18:37:26.667 DEBUG:teuthology.orchestra.run.gibba037:> sync && sudo umount -f /var/lib/ceph/osd/c1-2 2021-02-13T18:37:26.802 INFO:tasks.ceph:Archiving mon data... 2021-02-13T18:37:26.803 DEBUG:teuthology.misc:Transferring archived files from gibba037:/var/lib/ceph/mon/c1-a to /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877897/data/c1.mon.a.tgz 2021-02-13T18:37:26.803 DEBUG:teuthology.orchestra.run.gibba037:> mktemp 2021-02-13T18:37:26.806 INFO:teuthology.orchestra.run.gibba037.stdout:/tmp/tmp.iZ7liOdadx 2021-02-13T18:37:26.807 DEBUG:teuthology.orchestra.run.gibba037:> sudo tar cz -f - -C /var/lib/ceph/mon/c1-a -- . > /tmp/tmp.iZ7liOdadx 2021-02-13T18:37:27.077 DEBUG:teuthology.orchestra.run.gibba037:> sudo chmod 0666 /tmp/tmp.iZ7liOdadx 2021-02-13T18:37:27.129 DEBUG:teuthology.orchestra.remote:gibba037:/tmp/tmp.iZ7liOdadx is 1MB 2021-02-13T18:37:27.247 DEBUG:teuthology.orchestra.run.gibba037:> rm -fr /tmp/tmp.iZ7liOdadx 2021-02-13T18:37:27.253 INFO:tasks.ceph:Cleaning ceph cluster... 2021-02-13T18:37:27.253 DEBUG:teuthology.orchestra.run.gibba037:> sudo rm -rf -- /etc/ceph/c1.conf /etc/ceph/c1.keyring /home/ubuntu/cephtest/c1.data /home/ubuntu/cephtest/c1.monmap /home/ubuntu/cephtest/../*.pid 2021-02-13T18:37:27.298 DEBUG:teuthology.orchestra.run.gibba038:> sudo rm -rf -- /etc/ceph/c1.conf /etc/ceph/c1.keyring /home/ubuntu/cephtest/c1.data /home/ubuntu/cephtest/c1.monmap /home/ubuntu/cephtest/../*.pid 2021-02-13T18:37:27.315 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2021-02-13T18:37:27.315 DEBUG:teuthology.orchestra.run.gibba037:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-02-13T18:37:27.359 DEBUG:teuthology.orchestra.run.gibba038:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-02-13T18:37:27.380 INFO:teuthology.orchestra.run.gibba037.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-02-13T18:37:27.381 INFO:teuthology.orchestra.run.gibba038.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-02-13T18:37:27.391 INFO:tasks.ceph:Archiving crash dumps... 2021-02-13T18:37:27.399 DEBUG:teuthology.misc:Transferring archived files from gibba037:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877897/remote/gibba037/crash 2021-02-13T18:37:27.402 DEBUG:teuthology.orchestra.run.gibba037:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-02-13T18:37:27.547 DEBUG:teuthology.misc:Transferring archived files from gibba038:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877897/remote/gibba038/crash 2021-02-13T18:37:27.752 DEBUG:teuthology.orchestra.run.gibba038:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-02-13T18:37:27.766 INFO:tasks.ceph:Compressing logs... 2021-02-13T18:37:27.766 DEBUG:teuthology.orchestra.run.gibba037:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-13T18:37:27.770 DEBUG:teuthology.orchestra.run.gibba038:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-13T18:38:09.388 INFO:tasks.ceph:Archiving logs... 2021-02-13T18:38:09.389 DEBUG:teuthology.misc:Transferring archived files from gibba037:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877897/remote/gibba037/log 2021-02-13T18:38:09.390 DEBUG:teuthology.orchestra.run.gibba037:> sudo tar cz -f - -C /var/log/ceph -- . 2021-02-13T18:38:17.325 DEBUG:teuthology.misc:Transferring archived files from gibba038:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877897/remote/gibba038/log 2021-02-13T18:38:17.326 DEBUG:teuthology.orchestra.run.gibba038:> sudo tar cz -f - -C /var/log/ceph -- . 2021-02-13T18:38:28.914 DEBUG:teuthology.run_tasks:Unwinding manager install 2021-02-13T18:38:28.935 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2021-02-13T18:38:28.936 DEBUG:teuthology.orchestra.run.gibba037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-02-13T18:38:28.942 DEBUG:teuthology.orchestra.run.gibba038:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-02-13T18:38:29.002 DEBUG:teuthology.run_tasks:Unwinding manager clock 2021-02-13T18:38:29.016 INFO:teuthology.task.clock:Checking final clock skew... 2021-02-13T18:38:29.016 DEBUG:teuthology.orchestra.run.gibba037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-13T18:38:29.037 INFO:teuthology.orchestra.run.gibba037.stdout: remote refid st t when poll reach delay offset jitter 2021-02-13T18:38:29.038 INFO:teuthology.orchestra.run.gibba037.stdout:============================================================================== 2021-02-13T18:38:29.038 INFO:teuthology.orchestra.run.gibba037.stdout:-hv01.front.sepi 216.240.36.24 3 u 118 256 377 0.218 3.257 0.074 2021-02-13T18:38:29.038 INFO:teuthology.orchestra.run.gibba037.stdout:*hv02.front.sepi 163.237.218.18 2 u 211 256 377 0.244 0.126 0.083 2021-02-13T18:38:29.038 INFO:teuthology.orchestra.run.gibba037.stdout:+hv03.front.sepi 74.6.168.72 3 u 178 256 377 0.196 0.108 0.041 2021-02-13T18:38:29.038 INFO:teuthology.orchestra.run.gibba037.stdout:+hv04.front.sepi 144.172.126.201 3 u 132 256 377 0.233 0.109 0.025 2021-02-13T18:38:29.039 DEBUG:teuthology.orchestra.run.gibba038:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-13T18:38:29.060 INFO:teuthology.orchestra.run.gibba038.stdout: remote refid st t when poll reach delay offset jitter 2021-02-13T18:38:29.061 INFO:teuthology.orchestra.run.gibba038.stdout:============================================================================== 2021-02-13T18:38:29.061 INFO:teuthology.orchestra.run.gibba038.stdout:-hv01.front.sepi 216.240.36.24 3 u 127 256 377 0.177 4.672 0.659 2021-02-13T18:38:29.061 INFO:teuthology.orchestra.run.gibba038.stdout:*hv02.front.sepi 163.237.218.18 2 u 176 256 377 0.215 0.714 0.533 2021-02-13T18:38:29.061 INFO:teuthology.orchestra.run.gibba038.stdout:+hv03.front.sepi 74.6.168.72 3 u 125 256 377 0.164 1.536 0.598 2021-02-13T18:38:29.061 INFO:teuthology.orchestra.run.gibba038.stdout:+hv04.front.sepi 144.172.126.201 3 u 125 256 377 0.199 0.628 0.537 2021-02-13T18:38:29.062 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2021-02-13T18:38:29.077 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2021-02-13T18:38:29.078 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2021-02-13T18:38:29.095 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-02-13T18:38:29.112 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2021-02-13T18:38:29.129 INFO:teuthology.task.internal:Duration was 5881.468262 seconds 2021-02-13T18:38:29.131 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2021-02-13T18:38:29.143 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2021-02-13T18:38:29.144 DEBUG:teuthology.orchestra.run.gibba037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-02-13T18:38:29.150 DEBUG:teuthology.orchestra.run.gibba038:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-02-13T18:38:29.198 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-02-13T18:38:29.198 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba037.front.sepia.ceph.com 2021-02-13T18:38:29.199 DEBUG:teuthology.orchestra.run.gibba037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-02-13T18:38:29.231 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba038.front.sepia.ceph.com 2021-02-13T18:38:29.231 DEBUG:teuthology.orchestra.run.gibba038:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-02-13T18:38:29.247 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2021-02-13T18:38:29.247 DEBUG:teuthology.orchestra.run.gibba037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-13T18:38:29.273 DEBUG:teuthology.orchestra.run.gibba038:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-13T18:38:29.309 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2021-02-13T18:38:29.321 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2021-02-13T18:38:29.321 DEBUG:teuthology.orchestra.run.gibba037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-02-13T18:38:29.339 DEBUG:teuthology.orchestra.run.gibba038:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-02-13T18:38:29.367 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2021-02-13T18:38:29.381 DEBUG:teuthology.orchestra.run.gibba037:> sudo sysctl -w kernel.core_pattern=core && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-02-13T18:38:29.393 DEBUG:teuthology.orchestra.run.gibba038:> sudo sysctl -w kernel.core_pattern=core && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-02-13T18:38:29.408 INFO:teuthology.orchestra.run.gibba037.stdout:kernel.core_pattern = core 2021-02-13T18:38:29.414 INFO:teuthology.orchestra.run.gibba038.stdout:kernel.core_pattern = core 2021-02-13T18:38:29.427 DEBUG:teuthology.orchestra.run.gibba037:> test -e /home/ubuntu/cephtest/archive/coredump 2021-02-13T18:38:29.475 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-13T18:38:29.476 DEBUG:teuthology.orchestra.run.gibba038:> test -e /home/ubuntu/cephtest/archive/coredump 2021-02-13T18:38:29.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-13T18:38:29.484 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2021-02-13T18:38:29.498 INFO:teuthology.task.internal:Transferring archived files... 2021-02-13T18:38:29.499 DEBUG:teuthology.misc:Transferring archived files from gibba037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877897/remote/gibba037 2021-02-13T18:38:29.499 DEBUG:teuthology.orchestra.run.gibba037:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-02-13T18:38:29.553 DEBUG:teuthology.misc:Transferring archived files from gibba038:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877897/remote/gibba038 2021-02-13T18:38:29.553 DEBUG:teuthology.orchestra.run.gibba038:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-02-13T18:38:29.587 INFO:teuthology.task.internal:Removing archive directory... 2021-02-13T18:38:29.587 DEBUG:teuthology.orchestra.run.gibba037:> rm -rf -- /home/ubuntu/cephtest/archive 2021-02-13T18:38:29.590 DEBUG:teuthology.orchestra.run.gibba038:> rm -rf -- /home/ubuntu/cephtest/archive 2021-02-13T18:38:29.629 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2021-02-13T18:38:29.646 INFO:teuthology.task.internal:Not uploading archives. 2021-02-13T18:38:29.647 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2021-02-13T18:38:29.673 INFO:teuthology.task.internal:Tidying up after the test... 2021-02-13T18:38:29.674 DEBUG:teuthology.orchestra.run.gibba037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-02-13T18:38:29.677 DEBUG:teuthology.orchestra.run.gibba038:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-02-13T18:38:29.684 INFO:teuthology.orchestra.run.gibba037.stdout: 524339 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 18:38 /home/ubuntu/cephtest 2021-02-13T18:38:29.689 INFO:teuthology.orchestra.run.gibba038.stdout: 524339 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 18:38 /home/ubuntu/cephtest 2021-02-13T18:38:29.692 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2021-02-13T18:38:29.731 INFO:teuthology.nuke:Checking targets against current locks 2021-02-13T18:38:29.840 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/bin/teuthology", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/scripts/run.py", line 38, in main teuthology.run.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/run.py", line 412, in main report_outcome(config, archive, fake_ctx.summary, fake_ctx) File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/run.py", line 269, in report_outcome nuke(fake_ctx, fake_ctx.lock) File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/nuke/__init__.py", line 266, in nuke for unnuked in p: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/nuke/__init__.py", line 280, in nuke_one keep_logs = ctx.keep_logs File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/config.py", line 255, in __getattr__ raise AttributeError(name) AttributeError: keep_logs